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A gote from the editor. . . 

This is a single- topic issue of Investigations In M^iChetMicicg Educa* 
t_i on . It is devoced exclusively co abstracts and critical coranentary of 
reports of the Kacion^l Longitudinal Study oi Mathemaclcal Abilities 
(NI2MA) . The Advisory Board for IjE feels that a review and analysis of 
KLSMA reports is timely for three reasons. First, and foremost, we believe 
that the results are interesting and useful- Many mathematics educators 
have not acquired familiarity with the KLSMA reports simply because of the 
sheer mass of the study. Thirty-two volumes of KLSHA materials were pub* 
lished- This quantity of material about a historically interesting era 
in mathematical curriculum development has kept many individuals from a 
careful, critical perusal of the volumes. Ho document other than this 
Issue of IME provides the reader a detailed* critical sttmmary of the re* 
suits of the studies* 

Second* assessTnent at both national and state levels is a major 
activity and interest of the educational community today. WLSMA was the 
first Utge-scale testing program In mathematics edt*cation in the United 
States. Although HLSMA was not concerned primarily with assessment, we 
suggest that the experience with NI^MA should offer valuable leasons for 
those concerned with assessment- HLSMA had to identify and specify vari- 
ables and objectives. Testing Instruments were selected or constructed. 
Sampling techniques were developed and statistical procedures were 
selected. Mountains of data were processed and reports prepared. He 
opine that much is to be learned from the NLSMA experience that is directly 
applicable for Individuals designiiig and conducting large-scale assess* 
ments . Clearly* NX^MA was not designed exclusively as an evaluation pro- 
jectt but encompassed many other research goals. And you will discover as 
you read that the abstractors do question many aspects of HI5MA; some 
NI5MA processes and materials are identified as not suitable for immediate 
applicability. The point is that the mathematics education community 
should learn from this experience and apply this learning to current, re* 
lated tasks. Ve remark that thp abstractors have done an excellent job 
of identifying some of the perils and Pitfalls in such studies. 

Finally, HLSMA evolved in such a way that it served to raise 
questions and to Identify problems for researchers in mathematics educa- 
tion. Many of the problems need to be followed up to the point of develop- 
ing more precise research*based answers for curricular developers and 
mathematics teachers. We think this is one of the more powerful products 
of KLSMA- Researchers should accept the challenge of examlnii^g carefully 
the interesting instructional and curricular questions that are imbedded 
within the NI^MA^ studies. 

we are pleased with the enthusiastic response we received from 
the abstractors for this volume. Th^^y shared the perception of the 
Advisory Board that a review of the HLSMA reports was both timely and 
appropriate. We followed the usual policy of IJE in giving directions to 
the abstractors; namely^ that we would not change the substance of their 
abstracts or commentary. We did deviate in one way from the usual pro- 
cedures for selecting abstractors. The <luantity of material for the X- , 
Y- , and Z-Populations was simply too much for us to feel comfortable 
requesting a single person for a review. Consequently, we asked teams of 
iT^dividuals ±n each of three institutions to prepare the abstracts for 
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these three population groups* Abstracts were invited from individuals 
who had no previous connections with NISHA. 



In an Introduction , Begle^ Director of NlSMA.^ gives s brief 

overview of the aims and goals of NlSHA* TJien the abstracts of ten major 
studies are presented* The final section of this issue of IME Gives a 
brief annotation of the contents of each of the 32 published NLSHA reports 
and indicates its ava llabi li ty. 

We do hope that you find this targeted issue of IME Informative and 
useful . 

Alan El^ Osborne 
Editor 
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THE HfcTlOHiL LONGITUDINAL STUD¥ OF M^^THEMATI CAL ABILITIES 



The School HaChemaCLcs Study Group was otganLzed in 1958 and, during 
Che Sumner ot th^t year, prepared decaLled oudlLites o£ secondary achool 
sampLe cexCbooka for grades 7-12. During the following sumoter preliminary 
versions of texts for grades 7, 9^ 10, LI and 12 were completed and were 
pilot tested during the following dcad«mic year. During the summer of I960 
feedback froia the pilot teating was used in revising these texta (and 
coiapleting the preliminary version of the eighth grade text). Ihe reviaed 
texta were made available as of September 1, 1960 for any schools that 
jished to use them. Also during the suiinier of 1960, work began on the 
preparation of texts for gtadea 4, 5, and 6. 

The 5HSG Advisory Board felt that it was very important that s care- 
ful evaluation of the effectiveness of these texts be carried out. Ihe 
Educational Teating Service was commissioned to conduct this evaluation 
and did so during the 196G-61 academic year. Students using traditional 
texts were compared with atudents using SHSG texts. At the end of the 
year two tests ware adminiatered at each grade level. One waa a widely 
used standardized BIS teat, which was of course slanted toward the tradi- 
tional curriculum. The other was a test constructed by SHSG which empha- 
sized the particular topics in these texts that were not included in 
traditional texta. 

The results of this evaluation were not unexpected. Students using 
tra/iitional texts did slightly better on the traditional testa while stu- 
dents using the SflSG texts did better on the SHSG tests. 

This demonstrsted that the SMSG texts vere not inflicting any aerioua 
harm on the atudents using them and that these atudenta were learning new 
Ideas which might turn out to be useful to them. Unfortunately this eval- 
uation provided no further useful information. In particular it provided 
no guidance aa to how either traditional texta or the SHSG texts might be 
Improved. In retrospect it became clear that the global kind of teata 
used in this evaluation, each providing a single score for each student, 
were of only marginal usefulness in curriculum development. I^hat waa 
needed instead was a battery of diagnoatic teata, each devoted to s limited 
aspect of the mathematics curriculum so that the aucceasea and failures 
of a particular text could be analysed in detail. 

Accordingly plans were iranediately drawn up for a careful study of 
the effects of various Icinds of mathematics texta on the learning of 
mathematics, a atudy which would utilise diagnostic rather than global 
measures of student achievement and which would be longitudinal, following 
atudenta for five years, in order to detect long term as well as short 
term effects. 

This study was called the National Longitudinal Study of Mathematical 
AbiUtiea (NL$HA). During the 1961-62 academic year, a panel of distin- 
guiahed mathematiciana, mathematics educators, msthemstics teschers, snd 
psychologists outlined plsns for the study snd developed the initisl bat- 
tery of tests. At the same time a large number of elementary and Junior 
and aenior hig^ schoola were reoruited to participate in the study. These 
schools, while not forming s cross aection of the U.S. achool aystem, did 
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have a wide geogtaphic^L distribution and planned to use in the 1962-63 
academic year a wide variety^ both modern and conventionale of mathematical 
texts. Specifically, fourth grade (X-Population> , seventh grade (y-Popu- 
lation), and tenth grade (Z-Population) classes were recruited. Well over 
100,000 students completed the initial battery of teats in September of 1962, 

All of the participating schools were Informed that this vaa a natur- 
alistic rather than a laboratory study- SMSG exerted no influence on the 
choice of textbooks hy any of the participating schools, provided no con- 
sultant aetvlces to any of these schools and provided no free materials to 
thoae schools using SMSG texts. 

The overall plan for KLSHA called for the gathering o£ a great deal 
of information about each of the students involved in the study- It was 
generally believed that success in mathematics depended not only on the 
students* cognitive abilities but alao ott various affective variables such 
as attitudes toward mathematics, self-concept, etc- it was also believed 
that success in mathematics depended to same extent on characteristics of 
the students* teachers and on the socio-economic status of the school and 
comnunity- Consequent ^yi extensive Information on all of these variables 
was gathered during the course of the study- 
Data were collected in two ways- An extensive battery of tests was 
administered to each student at the beginning and at the end of each of 
the five school years (three in the case of the Z'Population studenta)- 
A lengthy questionnaire was filled out by most of the teachers involved 
in the first three years of the study- Other questiotmalres were filled 
out by the administrators of the schools involved in the study- 

The battery of teats administered to the students covered a substan- 
tial number of mathematical topics and in addition measured a wide variety 
of cognitive abilities and also measured a ntimber of affective variables- 
Guidance in the selection of the cognitive and affective psychologi' 
cal variables to be included in the study was provided bv a number of 
distinguished psychologists, some of them members of the steering panel 
and others serving as consultants- Guidance on the selection of mathe- 
matical topics to be studied was provided by a conference held In 
September 196J which brought together a total of 38 trtathematlcians ^ 
mathematics teachers^ mathematics educators and users of mathematics - 

Although a few standardized mathematics tests were used during the 
course of the five years of the study, most of the tests were constructed 
specifically for this atudv- The standard paradigm used In the construc- 
tion of these tests was the following; 





Number System 


Geometry 


Algebra 




Gomputatlon 








Comprehens i on 








Application 








Ana lys is 









The LOWS Ln the diagrjun «bove LndLc4ite different cognitive LeveLa 4it 
which the atudenta could b« expected to perform. The farther down one 
movea in thia matrix, the ntore complex 4ire the cognitive behaviora re- 
quired to function S4itiafactorily. A more detailed apecif ication of each 
of theae cognitive levela la the following; 

1* Computation - Items deaigned to require straight forward manipu- 
lation of problem elements according to rules the aubjecta pre- 
sumably have learned* Emphasis ia upon performing operational 
not upon deciding which operationa are appropriate* 

2* Comprehenalon ^ Itema deaigned to require higher recall of con- 
cepta and generalizationa or trana format ion of problem elementa 
from one mode to another, Bmpbasia is upon demonatrating under- 
standing of concepts and their relationships, not upon using 
concepts to produce a solution, 

3- Application - Itema deaigned to require (1) recall of relevant 
knowledge, (2) aelection of appropriate operationa, and (3> 
performance of the use concepts in a specific context 4ind In a 
way he hag presumably practiced* 

4* Analysis - Items designed to require a non-routine application 
of concepts , 

For each test session and for each population aeparately the coluom 
headings were sub-divided and more closely specified so as to be appropri- 
ate to the normal content of the curriculum for the relevant year. Then 
certain cells In the matrix were aelected (because of time conatrainta 
not all cells could be dealt with each y^^r) and a small number of teat 
itema apeciflc to that cognitive Uvel and to that mathematical topic, but 
varying In difficulty, were conatructed and, after pilot teating, were in- 
corporated in thfit battery for that testing period. These ^*ac4ilea" pro- 
vided very specific informstion about student achievement with reapect to 
specific mathematical topics at specific cognitive levels. 

It soon became apparent that the information being collected by NLSHA 
would be useful not only In inveatigating the differential effecta of 
various kinds of textbooks on student achievement In mathematics but alao 
in answering a targe number of other questions about varloua aapects of 
mathematics education. In the spring of 1965 a second conference, whose 
representativea again formed a broad cross section of the entire mathe- 
matics education conmunity, convened to review these questions and to rec* 
conmend priorities for the analyses of the data, TWo major analysea were 
carried out after the laat teating session in the spring of 1967, 

The first of these produced profiles of student achievement^ after 
IQ, previous achievement, etc ^ , had been factored out, on four seta of 
studenta* Theae sets were defined by textbook used, either the SifSG texts 
or s traditional text, and by the sex of the student. Both main effecta 
and interactions were calculated. 

In order to inform the mathematical community of the nature And of 
the findings of this study a total <>f 32 reports wa» prepared, A com- 
plete list of these reports is provided on page * The first nine of these 
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reporti provide background iBEormAtlon* Ihe Elr«t three locLude the «ctu*l 
teat Items used for each of the three populations. The next three describe 
«nd provide the standard ststlstlca on the various acaLea Included in the 
varloua teat b«tterlea. Report Ho* 7 provides a detailed dlacusslon ot 
the development ot the teat batterlea. Ho* S deacrlbea the varloua ata*' 
tlatlcal procedures used In the analysing ot KLSHA. d«ta* Report Ho. 9 
Includea the various questlonnslrea used to collect HI^MA. Infotmtlon. 

Reports 10 through IS contain the echleventent profllea eacrlbable 
to textbooks at the vsrloua griuJe levels ttom U through 12* Reporta 21 
through 25 are devoted to the second msln analysis of the NLSHA data, the 
effects o£ Individual varlablea on student achievement, Ihe reaulta of 
these analyses sre sunmsrlzed In Report No. 26. Ihe remaining HLSMA Re^ 
porta are devoted to smaller analyaes which utilised NLSHA^ data. 

All of the HI^HA data has been preserved. Inquiries concerning utlU^ 
nation of these data should be addressed to E. G. Beglet School of Educa* 
tlont Stanford Unlveraltyt Stanford* CA 94303. 
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PATTERNS OP MATHEMATICS ACHIEVEMENT IN GRADES 4, 5, AND 6: X- POPULATI ON . 
C^rryt L, Ray; Weaver, J, Fred. NLSHA Report No, 10 . 

PATTERNS OF HATUEHATICS ACHIEVEMENT IN GRADES 7 AND 8: X- POPUI^TION . 
Carry* L, Ray, NLSMA Report No, 11 . 

Expanded Abstract and Analysis Prepared Especially for I.H.E. by Joe Dan 
Austin and George W, Bright, Emory University. 



1 * Purpose 

The purpose of Reports No, 10 and Ko. 11 was to Identify differential 
patterns In raatheinatical achievement that niay be ascribed to different 
textbook series used continuously either Id grades 4 through 6 or in 
grades 7 through 8, 



2. Rationale 

This Is part of a study of the effects on students of varioua kinds 
of matheraatics programs. 



3. Research Desigtt and Procedure 

Student achievement was characterised by the 3x4 matrix presented 
earlier (see Begle*s article in this volume of I *M.E. ) . Non- achievement 
variables were verbal and non-verbal ability (as covarlates) and strati- 
fication (textbook and sex)* Textbook groups were classified as conven- 
tional or modern. The data unit was the mean score for all pupils in a 
school* On each scale* sum and difference scores for boys* and girls^ 
means for each school were analyied to test for sex x textbook interac- 
tion. Scales that did nor show an Interaction were analysed through the 
sum scores; those that did show an interaction were analysed separately 
for boys and for girls* 

Iti the analysis for grades 4 through 7 (fall), 317 schools were 
classified into six textbook groups--- three conventional and three modem. 
Four covariates were used iti analysing student achievement; Lorge-Thorn- 
dike verbal, Lorge-Thorndike non-verbal, ccjjnputation , and structure.. In 
the analysis for grades 7 (spring) through 8^ 198 schools were classified 
into eight textbook groups three conventional and five modern. Six co- 
variates were used: Lorge-Thorndike verbal, Lorge-Thijrndlke non-verbal* 
whole number structure, multipllcatlcrn of fractions^ algorithms^ and the 
Stanford Achievement Test, Not all covariates were measured simultaneously 



4.. Findings 

For each grade the foUowlog statistics appear in the reports; 

- raw score means, variances^ and standard deviations by text- 
book groups on the sum and difference variables (including 
covariates) 
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- correlation matrix for sum and difference variables 



- results of teattt for sex x textbook interaction 

- homogeneity of regression tests 

After tests for sex x textbook Interaction, the following statistics 
(with analyses conducted separately by *ex when appropriate) are presented; 

- regression coefficients) standard errors, and t*statistlcs for 
coefficients 

* statistics for regression analysis 

- correlations, vsrlancesi and standard deviations (covarlates 
eliminated) 

- analysis of covarlance for contrasts between groups 

- adjusted means, standardized adjusted means, and conditional 
standard errors of standardized adjusted means by textbook 
group 

- contrasts of the form Tk-Tl (ki*l), conditional standard 
errors, and t*statistlcs for the contrast** CCroup Tl was the 
SHSC textbook group) 

- first and second discriminant functions and test criteria for 
slgjilflcance 

- canonical form of textbook group contrasts 

For each scale there is a plot of a 90 percent confidence interval for 
the atandardiaed adjusted mean for each textbook group. Profiles of each 
textbook group are presented for those scales having significant variation 
across textbook groups. 

Grade 4 : See Table I, Groups T2t T5i T6 had higher adjusted means 
than gtoupa Tl, T3, T4 on X102 (boys and girls) and XlOl (less pronounced) 
but not on X103, X107 (boys and girls) separated Tl, T3t T4 (high) from 
T2, T4, T6; and X105 separated Tl, 14 (high) from the others, X109 (boys) 
separated Tl> T2, t3 (high) from t4> T5, No discriminant analysis was 
performed , 

Crade 5 ; See Table 2, Croups T3t TS* T6 were slightly higher than 
Tl, t4 on computation scales, X306 separated Tl* T3, t4 (high) from T2, 
T5, T6; and X308 separated Tl » T6 (high) from T2» T3, T5, On the discrim- 
inant analysis, t2 , T3, T5, T6 clustered together^ with Tl separated on 
the first dimension and 14 separated on the second. 
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Table 1 



STATISTICAL SUMMARY FOR GRADE ^ 



SCAI£ 



i 



B 

u 

Si 



XlOl; Subtraction of Whole Numbers 
X102; Division of Wtiole Numbers L 

X103: Subtraction of Fractions 1 



Tl T2>T5>T6 

B: T3 Tl T2^T5*T6 

G: T3 Tl T2>T5>T6 

B: T3 Tl 

G: Tl T2*T5*T6 



X104: Wt)Ole Number Numeration 
X105: IftioU Number Structure 1 
X106: Fractional Representation 1 
X107; Open Sentences ' Operations I 

XlOS: Open Sentences - Translation 



B* G* 



B** 



T2*T3*T4»T5*T6 Tl 
Ta»T3>T5pT6 Tl 
t^>TU Tl 

B: T2>T4^T5>T6 Tl 
G* T2jT3tT4*T6 Tl 



X109: STEP (Form 4B) 



B: T4.T5 Tl 



^05 
.01 



B: boys 
G: girls 



Modem: Tl(SMSC) >T3>T4 
Conventional: T2>T5>T6 
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Table 2. 



SIATISTICAL SUlWfcRY FOR QiADE 5 



5 



g 



SCALE 

X30I: Ptactlons 3 
X302: SeclnuiU 2 

X303: Slvlilon of Whole Numbets 2 



OS 

ii 



H 

Tl 13,14,16 
t4 Tl 

Tl T2,T3,T5,T6 



g 



X304: Declnuil Notation 

X30S: Translation 

X306: Geometric Figures^ 



T2>T3>T4,T4,T6 Tl 
T2,T3tT4tT5,T6 Tl 
T2,T5tT6 Tl TU 



X307: Working with Numbers 



T2»t3»T4jT5*T6 Tl 



I 

< 



X308: Five Dot* 



T2»T3»T4»T5 Tl 



.05 
.01 



B: boys 
G: girls 



Modern: Tl(SMSG) »t3,T4 
Conventional: T2,T5*T6 



•geometry scale 
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Grade 6 : See Table 3. Group T6 (high) separated from all other groups 
on X510 and frotn Tl> t2, T3» t5 (middle) and T4 (low) on X509, X5ll> and 
X522. X523 separated Tl, T4 (high) from T2 » T6 (middle) and T3, t5 (low); 
and X524 separated Tl^ T3, tU (high) from T2> T4. X527 separated T6 (high) 
from Tit T2 (middle) and T3) » 14* T5 Clow), Vao clusters appeared in the 
discriTninant analysis: (1) T2, T3, T5> T6 and (2) Tl, 14. 

Grade 7 (fall) : See Table 4. For X604 - X609> Tl » T2 > T6 (high) 
separated from T3, T4, T5, Tl, T6 (high) separated frcjm T3* T5 on 
X601; t2 joined the high cluster on X611 and X603 , with T6 dropping to 
the low cluster on X603 , On the discriminant analysis T2* T3* T4» T5 
seemed to cluster together* with Tl separated on the first dimension and 
T6 separated on the second. 

Grade 7 (spring) : See Table 5, All five computation scales showed 
differences across groups and satisfying homogeneity of regression were 
division scales. It was postulated that division was not mastered by 
grade 7* so these scales were most sensitive to differences across text- 
books. On these five scales there was a trend for T3, T6, T8 to be high 
and T4 to be low, X707 separated T5 (high) from T8; and 18 was low 
on X721, Discriminant analysis yielded three clusters: (I) Tl, T2 > T4, 
T5', (2) t3» T6, t7; and (3) T8, 

Grade 3 (fall) : See Table 6, Group T8 was high on X803, the only 
variable free of heterogeneity of regression problems and with significant 
differences across groups. No discriminant analysis was performed since 
only three variables showed significant differences across groups. 

Grade 3 (spring) : See Table 7, Groups T3j tS (high) separated from 
Tl» t5» T7 on X90l> X903, X906, and X908 > all computation scales. For 
comprehension scales no clear pattern emerged. X909 separated Tl> T2> T4 
(high) from T3> T5> T6, T7; X913 separated Tl> T4, T5 (high) from t3^ t6» 
T7; and X916 separated t3 (low), Discriminant analysis yielded three 
clusters: (1) T2» T4; (2) T3, T5> T6, T7 , TBI and (3) Tl , 



5 , I n t er pre tat i ons 

The results lend support to the conclusion that different patterns 
of mathematical achievement were associated with the use of different 
textbooks > and ^'unless the textbook Is the causal agent* other factors 
iwhlch do produce the differences also Influence textbook choices (Nc, 10> 
P' 167),** There Is also support for a distinction between the behavioral 
levels of computation and comprehension. In general there was a tendency 
for scales which were similar in content and behavioral dimensions (e,g,» 
nuoiber systems comprehension) to yield similar achievement patterns. The 
conjecture that achievement patterns would be similar within the textbook 
groups of conventional and modern proved to be too simplistic. The dis- 
crlmlnanC analyses dld» however^ provide limited evidence for delineat- 
ing textbook clusters. 
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Table 3. 



STATISTICAL SUfWARTC FOR GRADE 6 



SCALE 



i 8 



H 



H 
t 

it 



X508; Rational Nximbers 
X509; Multiplication of Fractions 
X310: Multiplication of Decimals 
X511: Division of Fractions 2 
X522: Stanford Achievement Test 



T2tT3,T4,T5,T6 Tl 
Ti Tl T2,T5tT6 
Tl T6 

T4 Tl T2tT5,T6 
Ti Tl T6 



X523: IJhole Dumber Structure 2 
X524: Open Sentences * Operations 2 
X525; Algorithms 

X526; Geometry - Informal Ideait^ 



T2,T3,T4,T5,T6 Tl 
T2tT4 Tl T3 
T2,T3,T5*T6 Tl 
T3,T3,T4*T5,T6 Tl 



X527; Estimating (?) 



T3,T4,T5 Tl T6 



<f*p 



.05 
.01 



B: boya 
G; girls 



^geometry scale 



Modern; Tl(SMSG> ,T3,T4 
Conventionalt T2,T5,T6 
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STATISTICAL SUHHART FOR G5RAIIE 7 (PALL) 



SCALE 

X604: Squ4irea of Numbers 

X605; Priictionft for Regions 

X606: Rtgiona for Fraction* 

X607: EquiV4il«nt Pr^iction^il 
Reprettentatioti* 

X60d: Pr4ictiODS 4ind Number- 
Line Point* 

X609: Number* - RAtion«l 

X610: Numbers - Whole 1 

X602; Algebr4i Nunber Froper- 
ties l** 



1 

li 

as 

Eh 

lib M 



P. 



T2,T3,'P4,T5 T1 
T2»T3»'P4»T5 Tl 
Ta.-rt.TS TX 
TS^-rt Tl 

T2»T3,'P4»T5,T6 Tl 

T2,T3,'P4,T5 Tl 
T2,T3,'P4»T5,T6 Tl 
T2»T3»'P4»T5,T6 Tl 



X601: Letter PuEzles 1 
X611: Axuilysis 1 

X603: Geometry - Sp4itial Reliitions^ 



T2,T3,'P4,T5 Tl 
T2,T3,'P4»T5 Tl 
T3»'P4»T5,T6 Tl 



.05 
.01 



B: boys 
G: girl* 



Moaem: Tl(SMSG), 13,114 
Convention*!: T2,T5,T6 



'geotnetry *c*le 
^4ilgebr4i scale 
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Table 5. 

STATISTICAL SUMMARY FOR GRADE 7 (SPRING) 



LEVELS of BEHAVIOR j 


SCAIE 


SEX X TEXT INTERACTION 


o 

S§ 


DIFFERENCES ACROSS 
TEXT GROUPS 


g 

H 




X701: 
X702: 
X703: 


Subtraction of Decimals 
Division of Decinalf 
SubtrActiot) of Fractions 2 










Tl 


TIQN 


X704: 
X705: 
X706: 


Division of Fractions 1 
Conversion to Percent 
Conversion to Deciroala 








c 

T4 


Tl T3,T6,T7,T8 
Tl 


IS 


X709; 
X711: 
X712: 


Reduction to Lowest Terms 
Subtraction of Whole Numbers 
Division of Whole Numbers I 








T6,T7 Xl 
Tl T6 




X717: 
X718: 
X7t9: 


Addition 
Subtraction 

Multiplication and Division 




B*f* G** 
fl*f* G** 


St 


Tl 


T2 




X722: 


Division of Whole Numbers 2 








Tl 


T7 


B 

g 

M 


X707: 
X70S: 
X710: 


Structure of Rationala 
Rational Numeration 
Problem Formulation 




B* 


** 


Tl 


T5 




X713: 
X714: 
X7Z1: 


Whole Number Numeration 
Decimal Notation 
S tructure 




B*f* G** 


it* 


T8 


Tl 


W 
M 


X715: 


Directions^ 


* 




** 


Tl 


T5 



*p .05 B: boya Modern: Xl(SMSG) ,T2,T3, 

**p .Ot G: girls T4,T5 

Conventional; T6tT7tT8 

^geometry scale 

^no significant contrasts with Tl 
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Table 6. 



STATISTICAL SVMiWlTt FOR GKADE 8 (FALL) 



s 

i 



SCAIZ 
X803; Fractions 3 



^1 



Tl TB 



XBOl; Open Sentences - Operjatlons 2 



X802: Wtiole Number Strtjcture 2 



Tl T4,T6,T7 



T4,T8 Tl 



**p *01 



B: boys 
G: girls 



Modern: Tl(SMSG) ,T2,t3, 
ConventlonAl: T6,T7,T8 
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Table 7. 

STATISTICAL SmWARY FOR GRADE 8 (SPRING) 



1 
U 

o 

a 
a 


SCALE 


o 

n 
X 


o 

C 

Bg 

S Ik 




DIFFERENCES ACROSS 1 


TEXT OlOUPS 1 


1 

1^ 


COMFUtWIOtl 


X901: Multiplication of Fractions 
X902i Multiplication of Decimals" 
X903: Division of Fractions 2 

X904; Division of Mhole Numbers 2 
X906; Conversion to Percents 
X907; Conversion to Decimals 

X90d; Division of Fractions 1 






- 

kk 
kk 
•k 

•k 


Tl T3,T6,T8 
Not interpreted 
Tl T3,T8 

Tl T3,T6,T8 

Tl T4 


U 


xyoyt Mumoers - Wnole £ 

X913: Fractions and Number-Line 

Points 
X914: Algorithms 

X9l5t Structure of Rationals 
X91&: Geometry - Constructions^ 
X910: Algebra - Number Proper- 
ties 1^ 

X9I7; Translation 




^kk Qkk 
G^ 


kit 
kk 

kk 
* 


4^ <^C 't^t 

T3,T6,T7 Tl 
T5 Tl 


APPLICATION 


X905: Scientific Notation 1 




G^ 






en 

1 


X911; Numbers - Problems 

X912: Geometry - Spatial Relations^ 




B* 

5* G^ 







*p .05 B; boys Modern: TKSMSG) ,I2,T3,T^,T5 

**p ,01 G; girla Conventional: T6,T7,T8 



^geometry scale 
''algebira scale 
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Critical Conm^ntary 



Among all studies on mathematical achievemei^t, Nl^HA stands out as 
one of the best planned and e^cecuted longitudinal investigations to date* 
The large number of subjects, the detsiUd analysis, the use of schools 
as data units, and the multl-^year testinj^ procedure are important positive 
features of the study* The availability of the Nl^MA data for foltow^up 
investigations Is a tribute to the careful vork of many people. 

The reports of the X-Populatlons results, howver, suffer from a lack 
of sumnariEation* The reader is overwhelmed by hundreds of pages of 
tables which are presented without adequate help In interpreting the 
thousands of statistics^ The Nl^HA authors would seem to be in a better 
position thart the reader to provide an appropriate context for interpre- 
tation* In particular, although the study is almost certainly too complex 
to permit a concise statement on the differential effects of conventional 
and modern textbooks, a clearer Indication of trends In achievement pat- 
terns across grades is needed. 

A few of the conclusions of the authors seem Co be inadequately justi- 
fied* For example, the authors state that "schools that used conventional 
textbooks during the period covered by theae analyses tended to produce 
pupils skillful at computation but not high in achievement, relatively^ 
on measures of comprehension, application, or analysis {No* 11, p* 164)*" 
This seeius to be an overstatement, since at grades 7 <spring)-8 the single 
application scale and two of the three analysis scales showed no signifi- 
cant differences across textbook groups* (One wonders why there were ao 
few application and analysis scales*) For the third analysis scale, X715, 
both the highest and lowest averages were achieved by "modem" textbook 
groups. Of the 15 comprehension scales for grades 7 and 8, only eight 
showed significant differences {only two, X707 and X916, were free of 
heterogeneity of regression problems)* Of these eight the highest ad- 
justed mean was achieved by a conventional text three times and by a 
modem text five tiiaes* If there were no differences, this is what would 
be expected since there were three conventional texts and five modern 
texts* Howeveri the lowest adjusted mean for these same scales was 
achieved by a conventional text five times and hy a modern text three 
times* For grades ^'-7 {fall) there were three application and four analy- 
sis scales* Conventional texts scored lowest on three of these seven and 
highest on two* of 20 comprehension scales, 19 showed significant differ^ 
ences* The highest adjusted mean was achieved by a conventional text 
three times and by a modern text L6 times, and the lowest adjusted mean 
was achieved by a conventional text ten times and by a modern text, nine 
times. In light of these figures, some jfurther justification Is needed 
for the authors* conclusions, at least with respect to the application 
and analysis scales* 

Another deficit in the report, at least from today's perspective, is 
the limited attention given to the relationship between sex snd achieve- 
ment. The sex x textbook interaction at each grade Is an imporant analy^ 
sis, but it does not give any infination on the relative achievement of 
boys and girls* All of the analysis of achievement by sex is contained 
in appendices {Appendix B in each report)* The authors do conclude that 
the scales for which the girls did better than boys (adjusted means) tended 
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to be at a lower level of behavior* At grades 4-6, of seven scales fa- 
voring girls, six were computation and one was comprehension* At grades 
4-6, boys outscored girls on one computation scale, 13 comprehettsiot) 
scales, one appllc4itlon scale, and three analysis scales* One wonders 
whether it Is possible to determine the approximate grade at which these 
patterns of differences begin to appear* 

A minor incottsistency In the analysis concerns the analysis of con* 
trasts vitb the SHSG textbook group (Tl> * In griides 4-6 separate an4ilyse« 
vere given for boys and for girls when there was a sex x textbook inter- 
action* However, for grades 7-8 uo separate analysis of the contrasts by 
sex was made iriien there was a sex x textbook Ittteraction, The authors* 
justification (e*g*, Ko* 10, p. 153 and Ko, II, p, 50) were not entirety 
convincing* 

Too little information was provided on the distinguishing character- 
istics of the different textbook series. The analyses are interesting 
as ^hey stand, but they would be far more useful if contemporary textbooks 
could be compared on important characteristics with those appearing In 
this study* ''Conventional" versus '^lodern*' is too vagve a categorization 
scheme to periDit such a comparison* 

Finally, the authors are to be commended for their search for addi- 
tional covariates. Since intact group* were used, thia search is impor- 
tant because the validity of the covarlate atialysls Is highly dependent 
on correct choices of covariates, A vide variety of possible additional 
covariates vas considered (Appetidix A in both Wo* 10 and Ko* 11), but 
none of these consistently Increased the percentage of variance explained* 



Joe Dan Austin 
George W* Bright 
Emory University 
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PATTERNS OF MATHQtATICS ACHlEVQfEHT IH GRADES ^> ^> and 6; Y-POPULATION. 
KlLpatrick, Jereo^; HcLcod^ Gordon. NLSMA Report No. 12. 

PATTEKNS OF HATU91ATLCS ACHIEVEKE»T IN GRADE 9: Y-POPULATION. Kllpatrlck^ 
Jereiny; HcLeod^ Gordon. NLSMA Report No. 13 . 

PATTERNS OF MATHEMATICS ACHIEVEMENT IN GRADE 10: Y-POPUU^T lOH . HcLeod, 
Gordon; Kilpatrlck* Jeremy. NLSMA Report Ho. 14 ^ 

PATTERNS OF MATHEMATICS ACHIEVEMENT IH GRADE ll! Y-POPULAT ION . Kilpatrlck* 
Jeremy; HcLeod^ Gordon* NLSMA RePort Ho. 15 . 

Exp4inded Abstr^ict and Analysie Prepared Especially for I.H.E. b7 ianses 
Sherrill» Diivid F. Robitellle» and Douglas T. Owens^ Unlveraity of 
Britiah Columbia. 



1. Purpoae 

HLSMA was undertaken by SMSG aa a *'long*tom «tudy of the effect* 
on atudenta of various klnda of m^theiutlcs progr«M." NLSMA waa funded 
to '^provide information for the further Improveinent of the achool mathe* 
matica curriculum^ to develop meaaurea of mathematica achievement more 
aenaitive to the wide range of outcomes expected from uaing various type4 
of textbooks^ to inveatlgate the i^ture of machenatica achievement ^ to 
provide information for achool peraonnel^ and to gain experience In oper* 
ating a large scale study in order to inform other inveatigatora wishing 
to operate aimilar studies^'. 

Findinga for textbook comparisons in the Y*Populatlon of NLSMA are 
presented in Reporta 12*15. Ihe Y*Popalation ia the middle sequence of 
gradea obaerved in NLSMA. Reporta 12*15 present information concerning 
textbook analyses for grades 7 and 6 (vol. 12), 9 (vol. 13)^ xo (vol. 14)» 
and 11 (vol. 15). 



2. Research Deatgn end Procedurea 

Ihe data unit for each variable in the Y^Population analyaea vaa the 
mean score for the students of a given aex within a particular achool 
using a particular textbook. In years one and two of NLSMA^ incluaion in 
the study required that a text had to be used in at leaat two achoola by 
at least 200 students In grades 7 and 8. During aubsequent yeara^ it was 
required that a textbook be uaed in at leaat two schools > by at leaat ten 
atudenta per achool and by at leaat two atudenta of each «ex. To be 
eligible a student waa required to have used one of the specified text^ 
booka and to have a complete aet of acorea for a given year. 

Studenta In the Y*Population were generally higher than average in 
mental ability^ mathematica achievement and socio* economic atatua. 

Ihe number of achools using each textbook group for each year ia 
preaented in Table 1. 



17 





Y-?opulatLon Textbook ClassifLcatlcms 
and Huntber of Schools 



Year 


Grade 


Textbook Clas^Lflcdtlon 

(Code/Humber of Schools for this Group) 


Total 


1 


7 


Modem CGI/137, G2/26* G3/23, G4/10* 
G6/11* G7/9, G8/2) 
Conventional (G5/36) 


218 
36 


2 


8 


Modern (Gl/133* G2/25, G3/24, G4/10* 
G6/ll^ G7/9, G8/3) 
Conventional (G5/39) 


215 
39 


3 


9 


Modern (Gl/95, G2/45, G3/7 , G4/81* G5/6, 
G6/23, G7/22) 
Conventional (CS/IA) 


279 
14 


4 


10 


Modern CT1/A4, T2/U* T3/6, T4/38, T5/42, 
T6/6# T7/8> T8/4) 

Conventional (t9/7, TlO/11, Tll/6, T12/8) 


162 

32 


5 


11 


Modern (Tl/32, T2/4, T3/77, TU/IB, T6/4) 
Conventional (T5/14, T7/5, T8/11) 


135 
30 



One cautionary remark made at the outaet waa that KI^MA. was an obser- 
vational stody^ not an experiment. The Investigators did not draw random 
samples of students from existing populations^ instead^ the population of 
students in Kl^MA. was determined by the willingness and ability of local 
school administrators to obtain groups of students for testing* Further- 
more> the NLSMA. investigators had no control over the textbooka that the 
students used since such decisions Are matters of local or state educa- 
tional policy. 

Since there was no control over initial differences among textbook 
groups, multivariate analysis of covariance was chosen aa the main statis- 
tical procedure. 

The data units on each covariate and dependent variable were the 
school mean for all eligible boys and the school mean for all eligible 
girls. In the analyais, the scores which were actually used were (1) 
the sum of the boya * mean and the girla* mean (sum vsrlable)^ and (2) 
the difference between the boys* mean and the girls' mean (difference 
variable). The multivariate analyses of covariance were conducted in 
the following manner? 

Step 1; Test for sex X textbook interactions by using the differ^ 
ence variables and multivariate analysis of covariance. 

Step 2: Teat for textbook differencea. In the absence of sex X 
textbook Interactions, the am variable form of the data 
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was u&ed for cav«riate$ aiid dependent variables in all the 
■tatistical procedures. In the presence of eex X textbook 
interactions, the analyses were done separately for each 
• ex. 

Step 3; Test for sex differences in those variables free of sex X 
textbook interactions by using the difference variables in 
multivsriate itndlysls of covsrisnce. 

Contiderable emphasis was placed on textbook group comparisons . 
These were handled by statistically independent contrasts, comparing the 
group mean of an SMSG text group (Gl for Yeara 1-3, Tl for Years 4-5> 
vitb the group mean of each of the other textbook groups. A Jt-statistic 
was calculated for each such contrast for each dependent variable having 
significant variation using adjusted means. In addition, the following 
statistical procedures were used; (1) multivariate stepwise regression 
analyses to determine relationships between the vector of covariates and 
the vector of dependent variables, (2) univariate F's to determine rela- 
tionships between each dependent variable and the vector of covariates, 
(3) multiple discriminant analysis to determine a linear function that 
maclmally separated the groups with respect to between-group variation* 
and (4) multiple R for each dependent variable since represents the 
proportion of variance predicted by the covariates. 

The testing data were collected us ing mathematics scales almost all 
of which were constructed for the study. The matbemaCics scales were 
classified according to the content of the items and the level of cogni' 
tive behavior they required. The three areas of content were number 
systems, geometry, and algebra; the four levels of behavior were computa- 
tion, comprehension, application and analysis* 

The timing of the administration of the various tests as well as the 
content and cognitive level tested are presented in Table 2. 



Table 2 



Number Systems Geometry Algebra 



Comiputation 


IS* 


5F 








3S 


5F 


5S 


domprehension 


IS 


2F 3S 5F 5S 


3S 


5S 




2F 


3S 


5S 


Application 


IS 




4S 


5F 


5S 








Analysis 


2F 


4F 5S 


2F 
4S 


3S 
5F 


4F 
5S 


2F 


3S 


5S 



*Year I, spring 
**Year 2, fall 
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Find in g j 



1* There were no aignificanc sex X cexcbook inceracciona for Years 
For Years 4 and 3 there was a sLguLfLcanc sex X textbook 
LnceraccLon on the algebra-computation acale* Also for Year 5 
chere was a sigjilficanc sex X textbook interaction for a 
geometry-dppLication scale. 

2* ?oTC Year 4 the t^o sexes performed at about the same level on 
the algebra-computation scale or else the boys performed 
notably better than the gitls for all textbook groups except T9. 

3. Every one of the dependent variables used in each of Years 1-3 
had a slgr^lficant percentage of its variance predicted by the 
corresponding set of covariatea* 

^* Almost all of the variables in all five years contributed 
distinct variance to the multivariate distribution. 

3. Multivariate analyses of covarlance indicated significant 

variation in adjusted scores on the dependent variables among 
the 8 groups used in Ye^r 1* An analogous result was obtained 
in Years 2-3* 

6* In Years 1-2 of the 154 cotitrasts, 48 were significant <F < 0-03) 
with 26 favoring G^* In Year 3, 31 of 63 contrasts were signif- 
icant with 25 favoring ♦ In Year 4, 25 of 77 contrasts were 
significant with 23 favoring Ti* In Year 3, 4 of the l4 con- 
trasts were significant with 1 favoring T^. 

Interpretat ions 
Fatterna of Achievement 

1* Mathematics achievement is a multivariate phenomenon. 

2> In grades 7-9, the conventional textbook groupa had similar 
achievement Patterns, but these patterns differed from the 
modern textbook r ♦Jps* In grades 7-10, the modem textbook 
achievement patter..^ differed considerably among themselves. 

3. Of the dependent variables free of sex X textbook interaction 
many showed significant sex differences <grade 7-8, 21 of 27 
dependent variables; grade 9, 3 of 11^ grade 10, 9 of 13; grade 
11, 4 of 10). In all 5 grades the differences which favored 
the boys occurred mainly on the analysis and/or application 
scales. The girls were superior mainly on some of the computa- 
tion scales^ 
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Froflltn of Textbooks 



GtJde_a 7-8 

L> A clear conclusion from the study V4S that, , > students are 
more Likely to Learn what they have been taught than soiaething 
eLse.** Bach group perfomed beat in those areas stressed in 
their psrtlcuL^r textbooks* 

2> The greatest differences among the textbook groups were on 
dependent variables dealing vith computation. 

3> Ho textbook group vss shown to be clearly superior in the 

higher processes of comprehenslofi, application and analyaia> 
This may be due to insensitivity of the scales used or to the 
texts themselves. 

The report did not examine the question of student ability X 
textbook interactions (true for Reports 12-15), 



1. KLSMA students who had studied from modem algebra textbooks 
did not out-perfom HLSMA students who had studied from conven- 
tional algebra textbooks on the four analysis- level scales. 
Hone of the groups did very well on the algebra-analyais scale. 

2. Many of the differences can be explained by an examination of 
hov the textbooks treated the topica being tested. 

3. "Hie consistent pattern observed in grades 7 snd 8 snalyses st 
the computstiona I level was not maintained, 

4. The differences among the textbook groups declined. 



1. The SMSG Geometry textbook group vsa above average on the two 
geometry* application scales cotmon to the Y- and Z-Fopulation 

2, The results for the Y-Fopulation geometry textbook ^ompsrison 
should be viewed as supplements to the corresponding snalyses 
for the 2'Populstion (Report 16), 

3, The differences among the textbooks continues to decline, 

4. Ito clear separation between the modem and conventional text- 
book groups was observed. 



I, The results of the comparisons thst occur in both the and 
Z-Populstions vere similar. 



Grade 9 



Grade 10 



Grade II 
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2* Hany different textbooks were used Ln Grade IL* 

3> Students' performance on a scale requiring them to work with 

inequalities appeared to be almost directly proportional to the 
attention Slven to inequalities in the textbook. 

4> In both grades 10 und 11, the variation in attention ^iven to = 
coordinate geometry in the different textbooks had little 
effect on performance on the related scales. 

5. The overall performance on the analysis scales of HLSHA was 
poor. 

6> As in grades 7-10, the textbook groupj differed more on a "lower 
process" than on '^i^er process** scalesi where all did poorly. 

7* Finallyi the pattern of the dif^rences among the cextbookc to 
decline continued. The amount of canonical variation accounted 
for by the first variate for grades 7*11 was as follows; Grade 
7 - 64%, Grade 8 - 72%, Grade 9 - 48Z, Grade 10 - Grade 11 * 

37%, 



Critical Conroentary 

One of the major contributions of Nl^HA has been in operating a 
large scale longitudinal study in the field of mathematics education; it 
probably will serve as a model for future studies of this kind. Another 
contribution of NLSHA was the provision of some support for the hypotheiia 
that mathematics achievement is a multivariate phenomenon.. 

Ihe results of the textbook compariaon analyses are interpreted with 
caution in Vols. 12-15. Ihis is as it should be, but it is unfortunate 
that stronger interpretations could not have been made> For example, 
although special efforts were made t^ measure differences in the higher 
cognitive processes I no consistent patterns of textbook differences were 
found. 

Ihe authors have prefaced each of these volumes with a atatement of 
three cautionary remarka.. They point out (1) that HLSHA was an obaerva- 
tional study, not an experiment; hence there was no randomisation of stu- 
dent or textbook groups; (2) that the analyaes were baaed on a multi* 
variate model of mathematics achievementi thereby making the identifica- 
tion of an overall 'Vinning** or '*losing" group irrelevant; (3) that the 
textbook comparison analyses were only the flrat in a seriaa of NLSHA 
analyaaa, 

A number of concerns about Vols. 12-I5i some of them related to the 
cautionary remarks, should be voiced. (1) There waa no control over the 
extent of uae of aupplementary textbooks and materialai although there 
waa conaiderable use of such materiala in aome caaea> (2) Diaproportion- 
ate numbera of schoola were aelected from certain geographical areaa 
(e.g.., California) and from among SM5G uaera. For exanplei over 80'X of 
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the schools In Years 1 and 2 were SMSG schools. <3) At least one conven- 
tional textbook "group'* ijx a given year was really a collection of groups 
using different conventional texts. <4) Although) the atithors describe a 
3x4 mathematical content by cognitive level matrix, few of the twelve 
cells were tested in dny one year: ^'g** only three were tested In Year I. 
For the Y-Population two of the celts were n^ver tested, (5) A very 
large number of the t~atAtistics was used each year in connection with 
textbook group contrasts on the dependent variables. Ihis approacb in- 
creases the likelihood of obtaining spurious results. However, it should 
be noted that there luere tdany significant ^-values found. 



James M. Sherrlll 

David Robltallle 

Douglas T' Owens 

University of British Columbia 
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FATTERKS OF MATHEMATICS ACHIEVEMENT IN GEADE 10: Z-POFUIATION. 
J«mei W. HIgMA Report Nd. 16. 



PATTERNS OF MATHEMATICS ACHIEVEMENT IN GRADE 11; Z-POHJIATIOH, Wilson, 
James W. NI^MA R*Port Nd. 17 . 

PATTERNS OF MATHEMATICS ACHIEVEMENT IN GRADE 12; Z^POPULATIOK, Ranberg, 
Thoin«3 A; VLlson, J«n€« tf^* NI£hA Report No^ 18 ^ 

Expander] Abstract jnd Analysis Prepared E«pecLally for I,H*E* by tfilH«m 
NLbbelLnk and H^irold Schoen, Ihe University of Iowa. 



I . Purpose 

Ihe Nt^MA Z-Populatlon Achievement Reports present st^tistlcsl de- 
scriptions and analyses of mathematical achievement at measured by teats 
presented in HLSMA Report No. 3. Report No. 16 deals with tenth-^rade 
geometry^ No, 17 deals with eleventh-grade algebra; No. IB deals with a 
variety of fourth-year mathematics offerings deemed to exhibit enough 
conmon emphases to warrant the construction of tests appropriate to all. 
Ihese reports present comparisons of textbook groups and examinations of 
possible interaction effects. Comparisons are based on examining linearly 
adjusted mathematics achievement scores, with adjustinent covariatea in* 
eluding measurements of general iitental ability and prior-^to-treatment 
measurements of mathematical achievement. 

Ihe authors emphasize that any such comparison 'Hs an analysis of 
existing. Intact groups and any such study is basically correlational. 
Patterns of mathematics achievement related to textbook usage are re~ 
ported; whether or not these patterns are textbook effects will retnaln 
only a hypothesis (NL5MA Report No. 16, page 1)." 



2, Rationale 

In the early 1960's '^experimental textbooks based on the nature and 
spirit of modern mathematics were being used widely* M6st textbook 
publishers had not had sufficient time to incorporate the modern mathe-^ 
matics point of view, organization and content" Into geometry or second*^ 
year algebra textbooks- "Hence, the experimental textbooks and the con- 
ventional textbooks in use provided an interesting contrast.. To examine 
such contrasts between alternative textbook presentations of mathematics 
instruction was one of the goals of NLSMA and ^ major reason the study 
was initiated (NLSMA Report No. 16, page 2; Report No, 17, page 2).'* 



3, Research Pesign and Procedures 

"Participation in Nl^HA waa on a voluntary basis. That is, an 
appeal vas made to school personnel through state supervisors of mathe- 
matica Instruction, professional Journals, and personal correspondence 
asking the school personnel to volunteer classes of geometry students to 
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participate in NLSMA for three ye«rs-- grades LO, 11^ and 12. The only 
control KI^MA exercised over t:hese classes was to be able to administer 
batteries of tests to these same students through grades 10, IL^ mnd 12* 
Classes were requested from all types of curricula. The choice of which 
classes to allow HLSHA to follow, the number of such classes^ tnd any 
decisions regarding the instruction of these classes wss left completely 
to the discretion of the school personnel <KLSHA Report Ho. 16, page Z>.** 
This initial request yielded an original Z-Fopulation from 215 schools* 

School meins were used as the units o£ data for Z-Fopulation text- 
book comparisons. For grades 10 ^nd 11 there was concern that boys* and 
girls* achievement patterns Tnay be different* tt was detemined that the 
appropriate unit of data for a given dependent variable would be a sum of 
means^ school mean for girls school mean for boys (HLSHA Report Ho* 
16, pages 2U- 25) . 

To quality for the geoiDetry study a school was required to have «t 
least 10 students. Including at least 2 boys and at least 2 girls^ for 
whom data on all dependent variables and covariates were reported. Also, 
it was required that a single textbook fitting one of the NLSHA classifi- 
cations was used* To qualify for the second-year algebra study the same 
types of requirements were enforced. To qualify for the fourth-yesr 
mathematics study, the requirements on number of students were altered 
to simply **five or more students'\ tt should be noted that **a school 
with 10 students would carry as much weight as one with 300 students. 
The school means data units based on fewer students probably vere more 
sensitive to selection bias--where a school selected students to partici- 
pate in KI^KA^ there was a tendency to choose the more able students 
(HLSHA Report Ho. 16, page 17)*^' 

All geometry and second-year algebra textbooks and some fourth-year 
mathematics textbooks were classified as being either modern, conventional, 
or transitional and/or modern but quite different. To so classify text- 
books **each textbook was examined by members of the HLSHA staff, by mem- 
bers of_the SHSG Research and Analysis Section, and by consultants to SHSG 
(NLStwTReport Ho. r6 , page^B);'* ^" ~ 

Schools were assigned to textbook groups on the basis of which text- 
book was in use- ^Vhen a school could meet the minimum criteria for both 
a conventional and a modern textbook, the data for the conventional text- 
book was dropped (NLSMA Report Ho* 16, page 13).*^ This decision was based 
on the proposition that **the nature and spirit of modern mathematics pro- 
grams tends to be carried over into classes using conventional textbooks^ 
while there tends to be less opportunity for transfer of point of view 
snd spirit from the conventional classes to the modern (HI^HA Report Ho* 
16, page L3>-" 

Table 1 presents a further description of Z-Population Textbook 
Groups as determined by the procedures described above* 
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Z- POPULATION TEXTBOOK GROUPS 



Number of 
Schools from 



NLSHA 

Text 

Group 

Mt Ion 


Grsde 
Level 


Ciasslfic&tlon 
of text ad 
Modern , 
Convent ionjil J 
TranBltional 


BoDk(s) Vsed Brief Descrip- 
tion of Book(s) Used 


Group of 215 
Initially 
Identified 
as Z-Pop. 
Schools 


Gl 


10 


M 




109 


G2 


10 


M 


Geometry with Coordinates j Parts X 
& SM5G, 1962 


13 


G3 


10 


C 


Any of IS text« listed on pages 
11-12 of KLSMA Reoort Ko. 16 
(copyrights: 1953-1962) 


34 


G4 


10 


M 


UICSM High School Mathematics. Unit 
6. Geometry. I960; UICSM Hiah 
School Mathematics* Course 2j 1965 


12 


GL 


11 


M 


Intermediate Mathematics. Parts I 
^ 11 , SMSGj 1961 


62 


G2 


11 


M 


Modern Algebra and Tri£. Structure 
and Method, Book 2, Houghton 
Mifflin Co. , 1963 


26 


G3 


:i 


C 


Alftebra. Book 2. Glnn & Co. « 1962 


11 


G4 


11 


c 


AlJtebra II: A Modem Course. Chaa. 
Merrillj 1962 


7 


G5 


a 


c 


Any of 9 second-year algebra texts 
listed on pages 13-14 of KLSMA 
Report Ko. 17 (copyrights! 1951- 
1962) 


17 


G6 


a 


T 


One of two aecond-year algebra texts 
listed on page 14 of NLSHA Report 
Ko. 17 (copyrights: 1962-1965) 


3 


G7 


u 


M 


UICSM HlKh School Mflthcmjttlca, Units 
5. 7. 8, 9, University of Illinois 
Press. 1960-1961 


7 


G3 


11 


M 


Algebra Ilj Addison Wesleyj 1962 


3 
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CGlA 12 H ElemeittJi^ Fuitcttoit» > SMSG* I960* 1961 36 

CGlb 12 Aity o£ 14 functions t«xt» listed oit 

pages 11-12 of NLSHA Report Ha, 18 
(copyrishts; 1956-1965) 65 

CG2 12 Any of 14 Crlgortoinetry texts listed 

oit pAges 13-14 of HLSM& Report Ho, 
IS (copyrishts: 1^3-1962) 47 

CG3 12 Any of 6 calculus texts listed oit 

page 15 of N1£HA Report (fo. 18 
(copyrights: 1955-1965) 17 

CG4a 12 M Iittermedijite Itothematicgi Parts I 

1961 is 

CG4b 12 H Any of 5 advanced algebra texts 

listed on pages 16-17 of NLSHA 

Report No, IS (copyrights: 1961* 
1963) 29 

CG4c 12 C Any of 12 advanced algebra cexta 

listed on pages 17-lS of HLSM& 
Report No* IS (copyrights: 1954- 
1962) 21 

CG5 12 No textbook 99 
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Ihe multivariate analysis of cov^ri^nce <HANCOVA) was the ceiitral 
statistical technique used to describe the pattern of variation of the 
textbook groups on the vector of mathematics achievement scores. Other 
statistics were used for various reasons* The statistics tests used for 
grades 10 and 11 are listed below In the order in which they were run and 
reported; (a) descriptive statistics Including means, common within- 
group correlations, variances, and standard deviations for each textbook 
group on each variable; (b) regression analysis to determine the relation- 
ship between the vector of dependent measures; (c) a multivariate (chi 
square) test and a univariate (F-statis tic) test to check the assumption 
of homogeneous regression across groups; (d> HANCOVA; (e) t-statiitics of 
the contrast of Gl with each of the other textbook groups for each de- 
pendent variable identified in the HANCOVA to have significant adjusted 
variation across textbook groups; <f) standardized adjusted nteana for each 
group for each dependent variable and graphs of the 90 percent confidence 
band associated with each in order to facilitate compariion; and (g) mul- 
tiple discriminant analysis to aid in determining those textbook groups 
that had similar patterns of performance on the dependent variablea* For 
each school a mean for alt boys and a mean for all girla were calculated* 
The final data analysis used combined data for both sexes by generating 
two new raw scores, the ^um and the difference of the boys' and girls' 
means* Ihe sum variables were used to compare the textbook groups, boys 
and girls, and the difference variables were used to identify sex x text- 
book interactions. For grade 12 the question of sex differences and sex 
X textbook interactions was not pursued. 

Restricting attention to gxades 10 and 11^ the following tests were 
used as covariates; 

pZ027i a 43 item Lorge-Ihorndike Verbal Test, 

P202Si a 5S item Lor ge- Thorn dike Non-Verbal Test, 

Z02$3 a 40 item algebra test, 

Z027, a 16 item geometry test, 

Z025, a 29 item test covering number properties, "advanced arithmetic", 
radicals, etc* 

Z114, a 40 item mathematics Inventory which includes scales ZlOUZlOG, 
Zlt2, and Zll3; most of which are used as dependent variables 
for the grade 10 analyses of achievement* 

Zlll, a 50 item test, the STEP Mathematics T^st , Form 2B; ETS, Prince- 
ton, flew Jersey; used as a dependent variable for grade 10 
analysis * 

Teat scales >ifled as dependent variables for gradea 10 and 11 are claasified 
in the next section of thia abstract, along with Information on numbers of 
items and means , 

There are two reasons for restricting attention to grades 10 and 11 
at thia point, Firat, including grade 12 would require too much space* 
Second, the abstractors tend to agree that "the 12th grade mathematica 

28 

35 

ERIC 



program in this country it so diverse, so vsriable from school to school, 
that it ia extr«meLy difficult to present any analysis of mathematics 
performocft (HLSHA Report Ho. 18, page 67)," 



4, Findings 

Testa (scsles) used as dependent variablea for grades 10 and IL are 
classified aa follows by HLSMA., Each entry in the mstrix below provides 
a triplet giving NLSHA test designation; number of items on test; mesn 
for sll atudenta. Almost all items on these tests were multiple-choice 
items with 5 choicea per item* 



Hmnber Systems Geometry Al&ebra 

2102; 7; 2-45 

COMPUTATION 2103j 4; 2-03 

2l04j 4j 1,03 

ZlOU 1\ 3.44 2301J 4j 2.17 Z305j 15j 7.86 

C0MFREHEN3IOH Z308; 6; 3.43 Z307; 7; 2.96 

Z309; 6; 1.99 

Z105; 6; 2.41 Zlll; 50; 28.68 
Zl06t 8; 3.97 



APPLICATION 



Z302; 6; 3.19 
Z304; 4; 2^40 



ANALYSIS 2310; 5; 1.89 2303; 11; 2.A2 2306; 15; 3.23 



(Any reader who Is Interested in examining the 2-Populatlon resulta care* 
fully is dtrongty encouraged to study these tests as presented in NLSHA 
Report Hos. 3 and 6.) 

Table 2 displays standardized medns for covariates and standardized 
adjusted means for dependent variables for grades tO and 11. Of sll co- 
varlstes, only Z027 for grade 10 failed to show differences between group* 
at a .01 level. This may be related to the fact that the mean for Z027 
over all students was low, 5.47 for 16 multiple choice Items (HLSHA 
Report Ho. 6, page 17). 
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Table 2. 



STANDARDIZED WANS FOR INDEPENDENT VARIABLZS (COVARIATES ) AND 
STANDARDIZED ADJUSTED MEANS FOR DEPENDENT VARIABIES FOR GRADES 10 AND LL 



Group StandardlEed Mean on Cov<ri<t< Stao4<rdlged Adimt^d Mean on Dependent Variable ' 

(Grade) P2027 ?ZQ2B Z026 Z057 Z025 Zm ZUl 2106_Z105 Z102_Z10J, Z104 Z103 ZUl 

Z302^Z304 Z30e Z305^Z307 Z3O6^Z309 Z3To""z30T 2303 

Gl(L) 47.76 47.44 48.43 49.39 49.35 56.0 56.8 44.6 44.2 48.2 48.9 48.9 

G2(10) 52.20 5L.2L 50.53 52.74 5L.74 42.7 49.8 44.8 50.0 54.4 61.3 50.3 

G3(10) 45.22 44.90 43.02 47.77 4L.47 59. a 53.2 46.7 44.7 50.2 39.3 51.9 

G4C10) 54.81 56.47 58.03 50.09 57.46 4L.6 40.1 64.0 61.2 47.1 50.5 48.9 
^t^t Hrk it^t ^« ii-k ipk -k^e iPk 



GlCLl) 


55. 


64 


54. 


83 


56.26 


G2(ll) 


52. 


45 


50. 


03 


50. 7 L 


G3(ll> 


44. 


64 


41. 


65 


38.41 


04(11) 


46. 


62 48. 


62 44.18 


G5(U) 


45. 


63 


43. 


85 


41.93 


G6(ll) 


48. 


86 


49. 


58 


53.56 


G7(ll) 


60. 


21 


65. 


25 


66.88 


Gd(ll> 


45. 


94 


46. 


18 


48.08 



iMnfc i^^t ifcifc 



55.24 57.66 56.51 55.02 

53.01 50.31 5L.45 5L.32 

45.34 35.65 38.32 41.49 

49.48 42.78 45.64 48.43 

46.36 40.78 44.66 46.09 

49.97 53.63 51.82 48.47 

57.58 66.99 64.46 62.77 

43.06 52.19 47.15 46.37 
ifriAf ifriAf ifriAf ifriAf 



63.6 55.4 


49.3 


53.5 


53.8 


58.3 55.9 


55.6 


58.9 


56.7 


47.5 51.4 


47.9 


54.3 


45.6 


5ia 48.1 


54.8 


54.3 


49.5 


44.4 49.1 


52.3 


52. t 


38.4 


55.4 48.6 


48.2 


40.6 


50.1 


28.5 40.9 


45.3 


40.9 


53.9 


50.9 50.5 


46.5 


45.8 


51.9 



49.1 52.1 51.2 48.1 52.2 

53.6 54.3 52.0 50.5 50.4 

48.7 42.4 49.9 55.8 48.0 

46.3 52.3 52.1 56.5 48. 0 

49.4 45.2 52.3 53.1 49.6 

46.8 52.9 49.2 49.2 54. L 
57.6 5t.8 48.5 40.4 48.6 

48.5 49.0 44.9 46.2 49.1 



^dlfferencea between groupa for grade level are atatla tLcally algnlflcant (p .05) on teat named above, 
^dlffereticea becweeti groupa for grede level 're atatla tically significant (p .01) on test named above. 



in both grmdea 10 and II the hypothcftla of hoinogeneity of regreaalon 
wa« teated uaing school means aa datm units for two textbook groups only* 
since the other groupa were amaller than the totml number of variabLea.. 
Tfie hypothesia of homogeneity of regression was found tenable on nil de- 
pendent variables except 2L02 and 2106 for tenth^grsde girla* Z302 for 
eleventh-grade boys* snd Z306 for eleventh-grade girla. **Tfiis hetero- 
geneity limits the interpretation of the reaulta on the two varimblea but 
appeared to be the result of b«aic«lly unstable regression surfacea in 
the two amaller groups as s result of the small number of data cases 
<KI£HA Report Ko^ 16* page 38)**' In addition* in grade 11 the heteroge- 
neity is not ''consistent across both sexes (NI^HA Report Ho. 18, page 19).** 

For grsde 10 *'sigiilficant sex differences were found on five of the 
seven dependent variables. Tfie boys scored higher in e«ch case." **Theae 
resulta «re in line with a trend found In other HI£HA Reporta for boya to 
ahov auperior performance on the higher cognitive levela (HLSHA Report 
Ifo. 16, page 78)/* For grsde 11, the differences favored the girla for 
algebrs scalea (comprehension level) and favored the boys for the geo- 
metry and nuQteration scales (application and enalysia levela). 



5. InterPretatlona 

Concerning sex differences, NI£M^ authora state that **lnterpretation 
and coment on thia pattern will be left to persona Involved in the KOfnen*a 
liberation movement (NLSHA Report No. 17, page 95)^* 

Concerning textbook differences in grade 10, **Berhaps the moat signify 
icant finding ia that the SHSG Geometry textbook group (a modern textbook) 
and the conventional vextbook group ahowed a aimilar pattern of achieve- 
ment. The patterna for the other tvo textbook groupa, both modem, were ^ 
distinct and appeared to reflect* in part, content unique to each textbook. 
Both the UICSH Geometry and the SHSG Geometry with Coordinatea textbook 
groups performed relatively low on geometry and raeaaurement scalea (lil£HA 
Report Ho. 16» page 79).** 

Concerning textbook differences in grade 11, **Brie fly a tatedt the 
modem texcbook group profiles showed auperior performance on all of the 
scales while the conventional textbook group profiles were lower in per- 
formance on the number propertiea, inequalitiea , and geometry scalea.... 
Only a moderate bias is needed. ..to conclude that for thia set of depen- 
dent variables, the modern programs represented by the larger textbook 
gTOijp samplea were superior to che conventional programs. The amaller 
textbook groupa may represent programs with particular program reaulta 
(KLSHA Report Ho. 17, pagea 96-^97).** 

Concerning findings In grade 12, **The analysla of twelfth grade 
mschematlcs curriculum patterna found remarkably similar performance on 
the limited set of dependent variables. Studenta who do not elect mathe- 
matics in twelfth grade, hovever, even though they have completed three 
yeara of mathematica by eleventh grade, vere found to have much lower 
performance (NLSMA Report Ho. 18, page 72).*' 
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Critical Comntentary 



Clearly, studies concerned prinutrily with a unique era national 
mood cAnnot be dupLicAted, Thus, suggestions regarding vhst might have 
been done differently will be few. Instead, a few questions will be 
raised^ questions intended to help anyone who decides to eicamine the I^I^MA 
Reports closely to detenoine the substantive significance of the findings, 

I, Is it reasonable to attribute achievement patterns by the modern 

teictbook groups to iitodern mathematics programs for the Z-PopuLation? 
Judging front copyright dates for materials^ such patterns are de* 
rived for children whose schooling was "conventional** for the moat 
part, 

Z, What is the "nature and spirit of modern mathematics programs" which 
was used to justify considering schools having both modern and con^ 
ventional programs only under the modem claasif ication (KLSMA 
Report No> 16, page I3>t Is it the same today as in the early 1960's? 
Could this ^'nature and spirit'* be a set of teaching strategies, per^ 
haps as old as Socrates, which over time experiences a series of 
rebirths? 

3, Why did so few schools offering conventional mathematics courses 
agree to participate in the NLSMA Z^Population Study? (Only 34 
schools comprised the conventional geometry group, compared to 13^ 
schools comprising Che modem group,) Was the appeal perhapa con*- 
ducted in a manner which made participation more attractive to schools 
satisfying the conditions for the modem classification? Was the 
appeal made with equal force to members of a representative aample 

of schools in the United States? (See NLSMA Report No, I6i page 20 

4, Were teachers ^n modern and conventional schools treated differen" 
tially? (See %LSMA Report No, 16, pages ix^x.) Was there a possible 
**ef£ect of differential treatment'* which influenced teachers and/or 
students, ov did teachers for one group receive more in-service guid- 
ance than ior Che other? 

5> With highly unequal numbers across groups, how much effect did the 
violar.ion of assumptions for MANCOVA have on the reported outcomea? 
(See the "Findings" section of this abstract,) 

6, For the fourth year, SHSG groups had a higher ratio of boya to girls 
than non-SHSG groups for both functions courses and advanced algebra 
court^es (NI^MA Report No, 18, page 9)* In both cases, such differ'^ 
ences in boy^girl ratios are s tstistically significant (p<,05r Chi^ 
Square). For all mathematics couraea presented by Report 14oa > 16, 
17, ard 18, data which allowed for making this obaervation were pre^ 
sentet;. only for functions and advanced algebra* Is this pattern a 
general gne for the Z^Population textbook groups? If so, ia ic s 
significant threat to the validity of the results when school means 
for dependent vsriables were calculated by uaing mean for boya mesn 
for girla? 
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1- For che fourth yor* the number students considered per school la 
considerably less for the convencionsl clsssif icscion than for the 
modern (14,5 per scboal vs, 21,1 per school). Does this suggest that 
convencionsl schools tended ta be either smsll or l^s* contmicted ta 
encouraging students toward pursuing mstbemsticsT Is this a threat 
to validity shich goes beyond the fsct that modern and conventional 
schools tended to be drawn from different geographic areas <NL5HA 
Report Ho. 16^ page 17; Ho* 17. page 20; No* 18. page 9>T 

8* Here there stated criteria for the classification textbooks (ss 
modern* conventional, tranait lonal^ or c>ther> which would allow for 
replication of the claaaification proceaa by others? 

9* Did the relstively short tests, often with very low mesns, f^snt 
enough sensitivity for investlgsting s '*Wide rsnge of outcooes" ss 
ststed in cbe purposes section of this sbstrsct? With schools used 
ss the units of dstsi why wss an item sampling technique not used? 

It is our opinion that the Z-Population Studies of Achievement sre 
limited mainly to forming s bssis for generstlng hypotheses ss ststed in 
the purposes of til^MA, not to resching conclusions. Alss for these hy- 
potheses) most may belong to an ers now spent* regsrding both the ststus 
of mathematics education in the United States and the relative atatus of 
the sexes * 



Willlsm Hibbellnk 

Harold Schoen 

The University of lows 
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N0N-IHTELI£CTIVE CORREIATES OF UNDER- AND OVERACHIEVEMENT IN GRADES 4 
AND 6, Xravert, K. J- KLSMA Report No, 19 , 



Expanded Abscrtcc and Analysis Prepared Especially for by Ellrtbcch 

F«iinema, Uitiversicy of Wliconain - Hadlson. 



1* Purpoae 

To seek evidence of the relaclonthipa of the following three »et» of 
vari4»ble» to under- »nd overachlevemenc: (1) pupild* attitudes and back- 
grounds; (2) teachers' opinions snd b^kckgrounds ; and (3) school character- 
istics of curriculum (textbook used) and school-conmunity data (sdmln- 
Istrative and socio-economic). 



2, Rationale 

Since achievement is the product of the interaction of the atudent 
with the teacher and school, it l9 essential to have knowledge of how 
teachers^ schools* and pupils interact, in order to understand what Is 
entailed in the learning of mathematics , Ihe study reported In this vol- 
ume was of an exploratory nature to gain seme understanding of thla 
interaction. 



3.. Research Design and Procedure 

A, Identification of Under- or Chrerachievejaent 

Under- and overachlevers were identified through the following 
steps; (1) Four predictor varisbles which sampled determinants of 
mathematics achievement were selected.. Itiese were the Verbal snd 
Non-verbal batteries of the Lorge-Ihorndlke Intelligence Xest^ a 
Computation Scale (a composite of 3 KLSMA Scales)* snd a Structure 
of Hathematics Scale (a composite of 2 NtSMA Scales), (2) A re- 
gression estimate of the "true" predictor variable scores was ob' 
tained by taking into account the unreliability of the measuring 
Instrtiments , (3) Obtained achievement scores (from the STEP Kathe- 
matlcs Xesti Year I, and Stanford Achievement Test^ Year III) were 
regressed onto the predictor varisbles^ (4) Predicted scores were 
computed for the end of Year I and Year III.. (5) Dlscrep^incy scores 
were obtained for each student for each year by subtracting oUtsined 
score from predicted score. An over- or underachlever was defined 
as one whose discrepancy score was more than one standard error of 
estimate above or below the regression line, 

B. . Subjects 

Students were drswn from the X-Populstlon of the NLSMA study and 
consisted of those students who were using the SM5G textbook (Modern) 
or the Holt* Rinehart and Winston textbook (Conventional), Results 
from testing in the fourth grade (Year I) and sixth grade (Year III) 
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w«re reported by sex and text. Students were drawn from 57 schools 
with About 375 teacher* <H * 3»527>, 



C. Independent Variables 

The independent varieblea were pupil> teacher* and school char- 
acteristics. The relationships between each independent variable and 
under- or overachievement were explored somewhat differently. 

Pupils ' attitudea^ perfomunce on cognitive scales and background 
meaaurea were collected. Attitudea raeaaured were; Arithmetic va. 
Hon-arithnetic> Arithmetic Fun va. Drill, Pro-arithmetic Compoaite* 
Arithmetic Eaay vs. Hard, Actual Arithtnetic Self-concept* Ideal 
Arithmetic Self-concept* Orderlineas* Heasineaa, Facilitating Anxiety* 
and Debilitating Anxiety, Alpha reliabili tiea* teat-reteat correla- 
tiona from Year I to Year III* and deacriptive atatiatics were pre- 
sented for the total group and by aex and text (Modern or Conven- 
tional). Changes in performance on each acale from Year I to Year 
III by each aex and each text group were indicated hy me^na^ atandard 
deviationa and differencea. The cognitive meaaurea uaed were the 
same aa the Predictor variablea (Verbal^ Hon-Verbal* Structure and 
Computation acalea). The pupil background measures analyzed were 
Sex» Fvnily Breadwinner* Education of Parenti* Occupation of Parents* 
TVin or Triplet^ and other language apoken at home. Chi aquare teata, 
simple regresaion analyses, and atepwiae regreaaion analyaes were the 
atatiatical techniques used to explore the relstionships between pupil 
meaaurea snd under- or overschievement. 

Tescher chsrscteristics collected were bsckground (professionsl 
snd trsining* etc.) snd messures of certsin sttitudes. Attitudes 
messured by the KX^M^ Tescher Opinion Questionnsire were: Iheoreti- 
osl Orientstion, Concern for Students* Involvement in T^sching^ Non- 
suthoritsrisn* Like vs. Dislike* Crestive vs. Rote* snd Heed for 
Approvsl. Mesns and stsndsrd deveistion^ for Modern snd Conventions! 
teschers were also clsssified sccording to sttitude level from low 
to high. Mesn pupil residual schievement scores were computed for 
esch tescher using the Verbsl^ Hon-Verbsl, Computstion* snd Structured 
predictors, Teschers were then clsssified on the bssis of mesn stu- 
dent residusi schievement scores es high* mid, or low effective* snd 
the sttitudes which helped discriminste between these groups of 
teschers were identified by multiple diacriminsnt anslyses. Exten- 
sion snslysis techniques were also uaed to generate rotated factor 
matrices for background information and attitudea. 

Data for participating achoola were gathered by uaing the HI^HA 
School-Cmnunity Questionnaire. The items on this queatioonaire 
were claasified into the following general categories: General Ad^ 
miniatration. Mathematics Instruction, and Sooio-Economic Factora. 
Contingency tablea were conatructed which ahowed the association of 
these cstegories with the over- snd underachievers , Significsnt 
relstionships were reported. 
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^* Find lnR< 



Findings w«re tuiuaarlced by vtrltbLe studied. 

^* Chtnget in tttltudet were more pronounced with the Con- 

ventional group then vlth the Modern group.. The ConventLonel group 
reported more poeltLve attitude chengee Ln view towerde mjth«!i»tlce. 
The Hadern group exhibited • decreeee in eeLf-concept.. ALL groups 
•how«d decLlnee in P«clLiteting Anxiety: Hodern girLe ehowed • 
nurked Increese in DeblLltetlng Aiuclety whlLe the ConventloneL boye 
•hoved • decreeee in DeblLltetlng Anxiety.. The intercorreLetione of 
the VerbaL end Kon-VerbeL cognitive eceLee reng«d from ..43 to ..66.. 
The Structure SceLe correLeted loweet (eround ..3) with the other 
cognitive meaeureef while the Btenderdlced tests Intercorreleted 
blgheet. 

The regreeeion enelyeea Indlceted thet even with four predictors, 
the multiple correletion with echievement wee only noderete: The 
Bete Weighte were .577 for Conputetion et the end of Yeer I end .690 
for Structure at the end of Year III. The predictors accounted for 
roughly hslf of vsrlsnce in the criteris. For the SUF Test <stsnd< 
srdiced criterion measure, Yeer I) the Lorge^Thorndike Verbal Teat 
wee the beat aingle predictor <r « .293). For the Stanford Teat 
<at«ndardiced criterion neaaure. Year III), the Computation Scale 
waa alightly better than the Lorge-Thorndike Verbal Scale <r'a - .275 
end .1^9 reapectively) . The Structure Scale provided little predic- 
tive power for any criteria. There waa a lack agreement of claa* 
aifying atudenta aa under- or overachievera on the baaia of the 
three criterion ref^rencea. The interpretation of the atepwiae re^ 
greasion anslyses indicsted thet no single sttitude or set of stti- 
tudes accounted for much of the varistion in the residusl schieve- 
ment scores which hsd been computed fron the regression coefficients 
for each group, with respect to over- sod underacbievers , me ny more 
eignificsnt relstionships with sttitudes were found for Year III 
Chen for Yeer I. Trends in the dsts were generally in the direction 
one would expect, i.e., students who preferred srithnetic over other 
Bubjects were frequently found ss overachievera. Trenda in the rela- 
tionahip between pupil background meaaures and over- and under- 
echievement were aa expected, i.e.^ children of 'Vhite collar" work* 
era were more apt to be overechievers thsn children of "blue collsr" 
workers * 

6.. Teschers. Teschers clsssified ss Modern tended to hsve higher 
scores on seversl attitude scsles. Ifhen tescher effectiveness wss 
measured by computing nesn residusl scores for pupils using the four 
predictors, greet vsrisbility between teschers wss found as well ss 
greet vsrisbility within s tescher sccording to which schievement 
messure wss used. 

C. gchools . Significant relstionships were found between many 
school vsrisbles snd the three schievement messures. No one schievs- 
ment ecsle sppesred to exhibit s pattern of relationships strikingly 
different than the others. However, the stsndsrdiced tests tended 
to hAve slightly fewer relstionships to Che school vsrisbles thso 
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did th« computation or atructure sc4iL«.. Hot 4iLL th« direction* of 
the r«Ution*hip v«r« th« aame for 4IL th« •caL«* «yeD thoufith the 
reliitionahip* were aignif ic4int 



5, Interpret^ttona 

There vere tto concLuaiona* inferences* impLlc4itionS| or auggeetione 
for further rese^irch nude by the ittveatigetor. 



The coDinent found 4ibove under 3 (Interpretation*) ie mtt Accurate 
•uiMury of thie 4ibetr4ictor cooncnte 4ibout thie 329-p4ige volume^ The 
lttport4ince of the topic under coneideriition ie well recognised ^ni ie 
being continually reinforced ve 4ire bombarded by preee rele^ieee thiit 

• pe4ik of the decline in nwthemeticiil achievement score*. The cheoreti- 
eel retionele of the etudy, while eketchy, ie edequete* The deeign of 
the etudy including eAmpld^ verieblee* criterion nceeuree, end epelyeee 
cennot be £eulte<l except in minor wmfM* However^ thie study ee it now 

• tend* hee two dujor flewe; (1) The reporting of the dete ie eo inede- 
quete thet interpretation by the reader ie elnoet inpoeeible Often te- 
bUe cennot be interpreted, e.g., in Teble 2.2.1 (entitled "Change in 
Attitude Heeeure fron Grmde Pour to Grade 6: Hodem Teat") Mean*^ 
Standard Deviation* and Difference* are reported with no iixJicacion of 
what "Difference" vean*. Another exenple i* in Table 4.2*1 (entitled 
'^imnary of Contingency Table* of dchool-Conmnity v*. Under- an4 Over- 
echieveoient Croup*: General Admini* tr* tion")+ Significant Chi *quare* 
are reported with an 'It'* but no indication i* given of the direction of 
the rel*tion*hip. Since the author oeiitted concluding renark* hlaaelf^ 
thi* lack of adequate data reporting i* extrenely *eriou*, (2) Ther* 
are no interpretive report* by the author. Thi* fact, coupled with the 
inadequate date reporting, make* thi* *tudy almo*t u*ele**. Th* magnitude 
of the data makea interpretation difficulty but certainly an Attempt 
ehould have been made to help the reader understand the implicationa of 
thi* study. 

One other area i* flawed *eriou*ly enough to warrant cooment. Sex 
i* included a* a variable ^nd treated inadequately. The inclueion of all 
other variable* is juetified. At no time i* any rationale given tor in- 
cluding e«x a* a variable and date concerning it ere included in a 
capriciou* manner* Certainly if a variable ia important enough to in- 
clude* eome rea*on for it* inclu*ion *hould be given. U*ing *ex a* a 
variable without ju* tif ication tend* to perpetuate the belief that Che 
aexe* differ In cognitive performance. 



Critical Commentary 



Ilitabeth Penneme 

Univereity of Hi*conein - H*dl*oa 
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CORKElAm OF ATTITUDES TOWARD MATHEMATICS. CtostwhLte, J. 
Report Wo. 20 * 

Expimded Abatttct •nd AntLytLt Preptted EtpecLtLly for I.H.E. by L^lt R. 
ALken, Stcted Hettt College. 



L . Purpose 

To examine the teeuLte of meeeutea of ettLtudft, eelf^cofic^pt, end 
•nxLety towetd ouithenutLce obteLned during the fLtet, third end fifth 
ye«te of the NetioruiL LongitUKiinel Study of HathematiceL Abilities 
CNISHA). Thft focue wee on LongitudlnsL compstisons of scores on the 
sbov« vstisbles in the subject popuLstiofi. 



2- Rstionmle 

Although there hsve been many studies of the rolft of effect in math«- 
mstics performance) few Investigstlons have involved the repested messure* 
nent of sttitudes over long time periods. The resesrch design of NISHA 
provided such sn opportunity. 

This volume reports the results of en analysis > ""conducted during the 
sunAcr of 1971, of the NtSHA effective domsin dsts. Prelininary foms of 
the sffective instrunents were designed in 1958 end sdministered to s 
nstional sample of SMS6 end noa-$HS6 students in the fall snd spring of 
1959-60. This initisl work led to the estsbllshment of s committee to 
study Psychological Factors in Hathematica Education (FFHE coomittee) and 
aubaequent development of the HL5HA Attitude Inventory in the early 1960'a 
The ten acal«a comprialng thia inventory include four meaaurea of attitude 
toward matherjatica, two meaaurea of aelf-concept , two oeaaurea of anxiety, 
and two meaaurea of orderlineaa. The attitude) aelf-concept, and anxiety 
scsles sre printed in Appendixes A, B snd C of the report being sbstrscted 
These ten scsles, plus eight sdditlonsl items, were sdministered in the 
fall of Year 1 and In the fall of Year 3 to the entire NLSHA population, 
and in the fall of Tear 5 to the X- and Y-Populationa. The PFW committee 
conducted a large number of atudiea involving the attitude inventory* the 
finding! of which are lunnarifed in HLSHA Reporta Noa. 1, 4, 5 end 6. The 
Crosswhite Investigstion represents a completion of the dsts anslysis whicf 
wss begun by the FFME cottmittee. 



3. Resesrch Design and Procedure 

Relstionshlps among the four sttltude icales (Hsth va. Kon-Hath, Hath 
Fun va. Dull, Pro^Math Composite, Hath Easy vi. Hard), two anxiety acalea 
(Facilitating Anxiety, Debilitating Anxiety), end two aelf-concept scalea 
(Actual Hath Self-Concept and Ideal Hath Self-Concept), three claaaea of 
achievement variable! (number ayat^Da, algebra> geometry) In addition to 
mathematlca gradea, and four intelligence variablea (verbal claaslflca- 
tion, vocabulary- -verbal analogy, numerical relet ionahlps, pictorlsl 
snalogy) were examined. 
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The aample employed in these an^klyses ^aas a five-percent stratified 
random sample of Year 4 of the NLSHA population. Data from 4953 students 
(1655 from the X-Populat ion, 2009 from the Y-Population, and 1289 from 
the Z-Fopiiletion) vere uae4 in the analyses. 



4* F%pd in&s 

Tables 2.1-2.3 of the report present the int ere orrel^kt ions «mong the 
attitude, self-concept, and anxiety scales in the and Z-Populations. 

The intercorrelations are fairly subscanti^il and stable across grade 
levels^ increasing slightly «t higher grade levels. All of the correla- 
tions dre positive except those for the Ideal Self-Concept and Debilitating 
Anxiety Scales . 

Tables 2.4^2.6 report the correlations between the eight affective 
v^iriables and the four intelligence variables in the three populations. 
All of these correlations are relatively small. The correlations of the 
eight affective variables with mathematics achievement scores are given 
In Tables 2<7-2.10. The pattern ^f correlations suggest a small but sig- 
nificant positive relationahip between attitude and achievement In 
mathematics > 

Chapter 2 of this report considers the means on the eight attitude 
variables at the various grade levels. The significance of changes in 
these means was determined by correlated groups 5 tests. Also, test-re^ 
test correlations on the attitude variables are given. In general, the 
results of the means analysis indicated that attitudes improved during 
elementary school, reached a peak during late elementary or esrly Junior-^ 
high school^ and steadily declined during the secondary- school years. 

An analysis of the means on the self-^concept and anxiety variablea 
revesled moderate decreases in real and ideal self-concepts, a pronounced 
decrease in facilitating anxiety, bfut an Increase in debilitating anxiety 
across grsde levels. Itie finding of substantially larger cest-retest 
correlations on the attitude variables at the higher grade levels points 
to the Increasing stability of attltudea during the high school years. 
NO SGX differences were found in these stability coefficients* 

Chapter 4 considers the means, standard deviations, and correlsted 
t-statistics separately by sex and grade level within each of the three 
populations. Although the attitude scores of both boys and girla ex- 
hibited the rise and fall pattern noted with the entire population, the 
mean score profiles across grade levels were far from identical for the 
two sexes. In general, there was a greater decline in the mean attitudes 
of girls toward the beginning of Junior-higli school than for boys. The 
attitudes of both sexes deteriorated during the secondary school grades, 
but the decline was greater for girls* 

With respect to changes in setf-concept snd anxiety, the Ideal Self^ 
Concept pattern across grade levels did not change appreciably for girls 
but became more negative Cor boys. Although girls and boys did not differ 
significantly in anxiety in the earlier grades, both groups decreased 
significantly in facilitating anxiety; this decrease was more severe for 
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girls than for boy*. D^bLLLtatLng anxiety scores, however, vttt stable 
mctoMM gt*d« level* in tht case oi b(>ys, but Lnct««s«d for girls. 

Chapter 5 compsres the attitude profile of students vho had used 
modem matbenatics textbooks with the profile of those who hsd used con- 
ventional textbooks* This cooiparison necessitated s rather severe re- 
duction in sample size, involving separate MtiMlyMtM over only tvo^yesr 
intervals* In the X-Population, the conventional group shoved grester 
attitude increases* In the Y^Population, the DU)dern group showed a 
greater decline in attitudes during the first tuo yesrs of the study* 
No differential effect due to type of textbook used vss found during the 
second two years of sttidy* 



Critical Conroentary 

This study represents a very thorough, statistically sophist icsted 
stislysis of fsUible data* The fallibility of the data in certainly no 
fault of the data analyst, and since the conclusions ar« consistent with 
those of other studies they should not be dismissed too hsstily* The 
writer of this NLSHA. report readily acknowledges the problem of generaliz- 
ability posed by Isck of representative sampling in the initial KLSHA 
population as well ss the sample of thst population selected for analysis. 
Me does not mention the facts thst the measuring instruments themselves 
may be faulted due to their brevity and SMkvsrd wording in spots, nor that 
the attitude scales concentrste on the liking for snd perceived difficulty 
of mathematics to the neglect of measuring the extent to which the value 
of mathematics to society is appreciated. Nor does he concern himself 
with the question* of whether conditiona of inventory administration, geo- 
graphical ares, social class, teacher cb«ractist ics , and other importsnt 
variables are related to scores on the inventory scsles* He does confess 
thst the data were rsther dsted by 1972 (and certainly by 1976t>» having 
been collected at a time of rapid change in education during the i960**. 

Whatever else one may claim of NLSHA, its directors were most sasur^ 
edly honest, thus, they have readily permitted publication of the results 
of comparisons which show thst the attitudes of modern textbook groups 
declined more than those of conventional textbook groups ^ a conclusion 
which is hardly flattering to SMSG materials . The remaining findings— 
substsntisl correlation* among attitude measures, low but *ignific*nt cor- 
relation* between attitudes and achievement, the riae and fall of attitude* 
across grade level*, and a greater decline in the attitude* of girls than 
boys in junior high achool-^are now well known but were not generally 
realized before being demonstrated by + 

Lewis R* Aiken 
Sacred Heart College 



4 / 

40 



ERIC 



ED 084 130 

TEACHER EFFECTIVENESS IN MAtHEMATlCAL INSTRUCTION^ Begle, E. G.; Geeslin, 
Williftm E. mSMk Report Ho. 28. 



Expanded At>«tract «nd Analysis Prepared Especially for I,M+E. by John 
Cregoryi University of Florida. 



I. Purpoae 

This report presents analyses of KLSHA data designed to ^'display the 
range of variation in effectiveness among Year 1 NLSM/t teachers and then 
to search for characteristics of these teachers that account for part of 
this variation in effectiveness.^* 



2. Rationale 

A four^page review of research (ending in 1970) was reviewed under 
the titles oft a. "Identifying the Effective Teacher,** b. *'Heasuring Change 
in Student Achievement, *' and c^ "Identifying Characteristics of Effective 
Teachers. 



3 . Research Pesi&n and Procedure 

The sample consisted of the approximately 60% of the teachers involved 
in NLSHA during Year 1 and Year 2 who returned the Teacher Opinion Ques> 
tionnaire (see NLSHA Report Ho. 9 ), and their students (from Year I, X- , 
Y-, and Z- Populations; from Year 2, X- and Y- Populations). This consti- 
tuted 1405 teachers from Year I and 1478 teachers Erom Year 2* 

All students were tested «t the end of the year to provide the two 
criterion measures of computation and comprehension ability. A series of 
tests (see HLSMA Reports Hos . 4, 5, and 6 ), administered at the beginning 
of the year or earlier, served as pretests of student ability. The tests 
differed for each population and from Year 1 to Year 2 due to differing 
content curricula. The pretests served as predictor variables for the 
criterion variables. Regression anjflysea yielded an "expected score*' for 
each child for each of the two criterion variables. These expected scores 
led to the identification of a HI and LO group for each teacher (HI: 
greater than the mean expected score for the given population; LO: less 
than or equal to the mean expected score). 

The average differences between HI students* actual and predicted 
computation (comprehension) scores yielded teacher effectiveness scores 
(EFF HI computation; £FF HI comprehension). Similarly, EPP LO computation 
and £FP LO comprehension scores were ccmtputed for each teacher. 

Four additional teacher measures were computed. The were; 



EFF HI computation minus EFF LO computation 
EPF HI comprehension minus EPP LO comprehension 
EFP LO comprehension minus EFF LO computation 
EFF HI comprehension minus EFF HI computation 
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Teacher ch*r*cterl*tlc measures obtained from the Teecher Opinion 
gue<tlonn*lre were u*«d In ateptrlse regreaalon an«lya&s to discover other 
relationships to sny of the eight effectiveness scores. These eleven 
v«rlsbles Included, among others, yssrs of teschlng experience, major In 
college, concetn for students^ attitude tCTwsrd mathematics, atkd whether 
or not the tescher had children of his or her own. 

The stepwise regression snslyaes were completed separstely for esch 
of twelve tescher groups^ or Z-Populatlons crossed with modem or 

conventlonsl textbook crossed with tescher sex. Correlstlons between 
first- snd secotkd-year effectlvenena scores were slso computed to determine 
stsblllty or effectiveness as defined by the process described sbove. 



4 * Findings 

Although substantlsl vsrlance for esch effectiveness score wss found 
to exist, tescher charscterls tics did not sccount for s significant per^* 
centsge of the varlsnce. In cases for which s s tatlstucslly slgnlflcsnt 
percentsge of vsrlsnce wss sccounted for (ss exhibited by multiple It^), 
the percentsge Is too low to be of vslue In prsctlcsl school decisions* 

Fslrly large percentsges of vsrlsnce for some teacher effectiveness 
difference scores were accounted for by the teacher chsrscterlstlcs , but 
no distinct psttern could be sscertalned. 

It wss slso found thst teacher effectiveness scores were not very 
stsble from Yesr 1 to Yesr 2. 

(The report contains 123 pages of numerical dsts snd ststlstlcal re- 
sults of the snslyaeaO 



5. Interprets tions 

The major conclusloTi made by the suthors (In the three psges devoted 
to stmnary and discussion) is thst It was not possible to demonstrste thst 
the tescher charscterlstlca, which many people have felt to be Inportsnt, 
have sn effect on learning. 



Critical Cow Twfti-jrtf 

The authors of the report and the results from othsr Inves tlgstlon^ 
conducted since ths dats collection stags of this report, Issd to several 
queatlona. 

(1) If dsts relstlve to the verbsl environment of the classroom hsd 
been snslysed, might mors of the vsrlsnce In Eff scores been sccount- 
ed for? Dsts <&f this typs would Include the manner In which the 
tescher sets toward snd rsscts to students (sffectlve behsvlor). 
Tsxonomlc levsl behsvlor of the students as esdilblted by teachsr 
questions and/or student responses would slso be dsts of this type. 
Analysis of ths linguistic qusllty of the verbsl snvlronment pro- 
vides s third source of dsts of this type. The emphssls of this 
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anmlysls Is how the teiicher* In pattlcuLAt^ 9'.iy5 what be say« t«thet 
chmn what Is s4iid (for example* use of logical connectives, use of 
lecture preceding questions, and the use of silence). 

(2) Although two teachers use the same textbook and have similar 
personal characteristics, they can differ with regard to the seqi;enc- 
ing of Instruction, both within a given lesson and within a given 
content unit. This leads to a second question: If data relative to 
the planning and delivery of the mathematical content had b«en ob* 
tailed In terms ^f the sequence of liistrt;ctional moves, might more 
variance in ZFF scores have been accounted for? 

The variables referred to would include the number of examples 
presented prior to, or following, a definition of a concept or a 
desctiption of a mathematical process* The tme of counter-examples 
and eliciting interpretations through comparison and contrast would 
also be examples of these planning and delivery variables. 

(3) Are there variables other than the achievecnent measured by the 
Instruments used in NI^MA which would provide more stsble effective* 
ness measures? Of particular concern to the authors of the report 
on this point is the possible effect of subject matter, student 
characteristics, and instructional objective variation on the sta- 
bility of the EFP scores. 

John Gregory 
University of Florida 



43 



ED 084 L3L 

fOUOK-UP STUDY OF NISM^ Z'VO¥\JXATlQH* Br«nci, NLchoLai. KISMA Report 
Ho, 30 . 

Exp«iu)«d Ab«tr«ct «nd An«Ly«L« Prepared E«pecL«lLy for I..H..E. Arthur 
Coxford, The UnLver«Lty of HLchlg«n. 



1- Pur^oie 

The purpo«e w«« to «««««« Z<^PopuL«tLofi Cgrftde* L0-L2) opinion* on « 
number of que«tlon« pertaining to ntthenutlc* achievement, «ttltud««> 
c«re«r«, «chool Inatructlon, textbook*, te«cher«, et ceter* In the fourth 
year of the HLSHA 3-ye«r atudy.. in particular the «tudy «ought to deter* 
silne If there were difference* In opinion* on «cl«ct«d topic* related to 
the type of text materlele uied In gredee 10-12: conventional or modern.. 
Finally the etudy eought to determine whlch> If eny> verleblee dlecrtmln- 
eted groups of etudente cetegorlxed on their responeee to ecverel Indi- 
vidual queetlonnelre Iteme. 



2* Rationale 

Whereaa the X and Y population! remained In ichool for the 3 yeara 
of HLSMA teatlngf the Z-Fopulatlon waa In achool for only three yeara of 
the atudy. The SHSG Panel on Teata aought to continue collecting Infor- 
mation on the Z-Populatlon by meana of a queatlonnalre to be admlnlatered 
on6 year after completion of grade 12. Thli would provide Informetlon 
different from any collected for the X- and Y-Populatlona. 



3- Reaearch Deilgn and Procedure 

Several toplca for the queatlonnalre were auggested by the SM5G 
Panel on Teata. Additionally, «n UISCH follow-up Instrument waa con- 
aulted In preparing the preliminary questionnaire. The preliminary quea- 
tlonnalre waa piloted with 200 high school graduatea and 100 junior 
college atudenta. Reaultant data were analyzed and uaed to revlae the 
questionnaire. The final queatlonnalre waa mailed to 13>OdO acudenta In 
the ^-Population. Of tbeae, 6623 returned completed quea tlonnalrea , 6372 
did not reapond, and 83 returned Incomplete quea tlonnAlrea . Further 
attempts were made to obtain reaponaes fron a 19d-peraon randon aample 
of Initial non-respondenta . One hundred fifty-nine atudenta reaponded to 
thla apeclal mall and telephone autvey. Thirty nine did not respond or 
could not be reached. 

The 198-0ubjecc random sample of non-reapondenta waa carried out so 
that the Invea t Iga tora could determine whether the 6623 reapondenta were 
repreaentatlve of the 13,080 surveyed Z-Populatlon nembera.. A chl aquare 
analyala and aeven of 22 multiple t teata of HLSHA Teata data for re- 
apondenta and non-reapondents were a ta tla tlcally ilgnlflcant. The reaulta 
were deemed aufflclent to conclude that the reaulta fron the Initial 
queitlonnalre were not generalluble to the entire Z*Populatlon follow- 
up group* but only to the group that reaponded Initially. Theae reaulta 
led Che Investigators to analyze the Initial reapondent and randon aample 
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group data Indlvldt^HaLLy and to make only infomuL ccmparlaoita bettreen 
th« two* 

For analyaia, tha reapotidenta were partitioned on tbe typ« of nmthfi" 
aatica t«xtbooka ua«d in high achooL iimth«Byttlc9 . 

SCSoHic y^ara) : R«apondenta uaed modem or conventional texti (but 
not both) for their mathematica inatruction of 2 or 3 years (a oatbe-* 
nmtlca couraa «r«a elected it Leaat one of the tenth-*, eleventh- or 
ttrelfth-* grade ye«ra)i 

Btlvery veir) t ttcapondenta uaad modem texta for 3 yeara or conven- 
tional texta for 3 y^ara* that ia* i mathematica courae waa ^l^cted ftv«ry 
yaar in high achool, gradea 10^12. 

The aecond dimenaion for a two-tray claaaification waa one of the 

following fivei 

m) Intended choice of profeaaion; math or math related va* all 
othera 

b) Intended college major: math va. physical aciencea or engi- 
neering va. all others 

c) Indication of high achool math text clarity 

d) Indication of high achool math text level of difficulty 

e) Indication of high school math text relevancy of material. 

Theae two-way c l«a:)if ica tions w«re analysed by chi-aquare. 

A aecond aet of analyses were carried out to determine which of 42 
variablea (22 previoualy meaaured snd 20 queationnaire) diacriminated 
certain groupa of reapondents The groupings were: 

1* Reapondenti intending to specialise in math va^. reapondents in- 
tending to specislise in physicsl science or engineering 

II, Respondents intending to specialise in math vi* respondents In- 
tending to 9pecislise in aress non-relsted to math 

III. Respondents planning to enter s strongly math related career 
vs.. respondents plsnning to enter a non^math related career. 



Find ings 

Of the twenty chi-square snalyses csrried out^ the following showed 
statisticsl signif Icsnces 

Initial Respondents. 

1* 5(soa)e yesrs) by Choice of College Major (b) 
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2* 3(*(nw year*) by Textbook Clarity (c) 

3* 3(e(nw yeere) by Textbook Difficulty (d) 

4* E(ev«ry yeer) by Type of Career Plenned (•) * 
R«Qdoin-3emple Reepondente* 

No eignificent chi-equere enelyacte. 
DiSCRIHlNm ANALlfSES 

For diecrlminent enelyeie 1, 11 of the 42 variable* differentiated. 
Th6 firat five were: 

1* preparation for poat-hi&h achool acience 

2* preparation for post-high achool math 

3. diapoaition to take math couraea 

4 . ana grama 

5* attirude ro^ard Algebra I 

For diacrlmlnant analyaia n, 12 of the 42 variables diacriminated . 
The firat five were; 

1* diapoaition to rake math 

2* math vs. non'mtth 

3* numerarion 2 

4« Independenr math study since high school 

5. informal geometry 2 

For diacrimlnant analyais III, 18 of the 42 variablea diacriminated . 
The first five could not be included because the appropriate table was 
TOisaing from the original docoment* 

Descriptive dara for initial respondents and random aample respond- 
ents were alao reported. They cannot be included here. 

5 ♦ Interpretationa 

The deacriptive data on the questionnaire respontea suggest the 
following generalizations: 

I* All respondents (initial and random sample) rated themaelvea 
less favorably In school work as Che level of schooling in- 
creased. 



46 



ERIC 



53 



2* All respondents indicated th<t the degree of difficulty of their 
matbe^matici increased the level of achoollng increased . 



3* All respondent* indicated an incr«tasing aislike for matheTnatlca 
MM ttie level of schooling increaaed* 

4. The popularity of mattiematics in relation to other school sub- 
jects decreased aa school level advanced. 

5- The majority of reapondents indicated that their high school 

mathematics couraea atlmulated them, their high school teachera 
made mathematics intereatlng, their high achool teachers 
follCTved the text closely, their courses prepsred them for 
post^high school work, and mathematics rsnked mm one of the 
top three most importsnt school subjects- 

The chi-aqusre snalyses led to the following observations; 

1- The modern math text uaers SCsome yesrs) plstmed to choose 
msth, physicsl science or engineering aa college major. 

2, The three-year modern math uaera E(every year) planned more 
math-related careers than conventional text oaera. 

3, The conventional text uaera E(every year) rated their textboc^s 
clesrer . 

4, The modem text users E(every yesr) rated their textbooks more 
difficult. 

The dlscrlminsnt analyses Ud to the following observat iona; 

1. For each pair of groups, the disposition to tske math courses 
distinguished the groups with the math'relsted group showing 
the grester disposition. 

2. Respondents plsnning to enter engineering or physicsl science 
msjor were sigjiificsntly less disposed to tske math courses 
than were those plsnning s math major. 



This is sn Interesting study worth of careful study- The descriptive 
dsts deserve csrefu; exsmittstion to gsin clues ss to how students view 
their teschers, texts, etc. It would be vslusble to have a similar atudy 
todsy. This reviewer would conjecture ttist the tesults would be substan* 
tially different. 

TWO ahortcominga of the report aret 

1. Table 4.27 waa miaaing from the document examined. 

2. The oae of a p value of .0532 aa aignificant (aee page 94 and 
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pages 109>110). 
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£D 034 132 

CHARACTERISTICS OF SDCCfiSSRJL IKSIGHTPUL PROBLEM SOLVERS. Dodicm, 
Jo»ph V, MLSMA Report Ho, 31 , 

Expanded Abstract and AnaLysLs Prepared EapecLaLIy for I,.H..£, by Frank: 
K>^ Leatert Jr,, Indiana DnLversLty, 



1 ► Purpose 

Thli study waa desl6^^ to characterize aucceatful "Insightful" 
problem aolveta In tema of four categorlea of varlableai (1) nathematlca 
achievement varlablea; (2) student cognitive and affective vsrlablea] (3) 
teacher background and attitude variables; and <4> schools coivnunlty^ and 
curriculum variables. 



2, Rationale 

Although conaldetable research haa been devoted to the study of 
problen solving, very little Is undetatood about the problem- a olvlng pto- 
cess becsuae students typlcslly exhibit very little observsble behavior 
while working on problems. In addition* many of the measures of problem- 
aolvlng ability are restricted to messures of ability to solve routine 
problems which appear In msthematlca textbooks.. Hessures of this type 
often do not assess m student's ability to solve problems thst require 
original thought, A key festure of this study Is that the probleiw In-^ 
volved 're considered to be nonroutlne and are Intended to be s challenge 
to the problem solver. There Is growing Interest within the msthematlcs 
education coamunlty In the development of currlculs snd assoclsted In- 
structlonal techniques which enhance the student's sblllty to solve non> 
routine problems. Before such currlculs snd Instructional techniques csn 
exist) a better understsndlng must be gained of the processes of problem 
solving snd hew these processes develop. Specif Icslly^ resesrch Is 
needed which relstes problem solving sblllty to student charscterlstlcs> 
thereby providing a basis for hypothesizing conditions for success In 
problem solving and enabling currlcultmi writers to select apptoprlste 
activities for instruction In problem solving. 



3, Resesrch Desian snd Procedure 

A multlvarlste research design was chosen to determine , the rele-* 
vsnce of 77 concomltsnt vsrlsbles for the sblllty to solve Insightful 
mathemstlcs problems snd to determine Which of these vmrlsbles discriminate 
best among sblllty groups (p, 3)," The study used data from the irt^HA 
Z^FopuIstlon since the Insightful mathenuitlcs problems which comprised the 
criterion test were sdmlnls tared only to this populstlon, Concomltsnt vmr> 
tables were chosen from among mathemstlcsl snd nonmathemstlcsl vsrlsbles 
hypothesised by NLSHA ss being relsted to mathemstlcsl sblllty. The spe- 
cific vsrlables used In this study were those whose scales bsd been ad- 
ministered to the entire Z-Fopulstlon snd were spproprlste for use In the 
silstlstlcal anslyses. These varlsbles were clssslfled as Type A (mathe- 
matics! schlevement vsrlsbles)* Type F (psychologies! vsrlsbles - cognitive 
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ptocesse* and •ccicudes), ^and Type D (non-cedc d4ic* - teacher biickground 
•nd iittLtude, •chooL-comoutiLcy ch^taccetLstLcSf machenmcic* cuttLcultim 
v*tL4ibLeft, ^nd socLo-econoinLc Index), Hoac of the LnsLghcfuL iQ*ch«m«cLC9 
problems w«re aftlecced from four NLSM^ acalet: Itnlg^cful Geomecry , 
Algebraic Eqmiclons - Inal&ht 1 ^ Number Properties 1 ^ and Atmlv«l< 2 , 
The rescrlcclon of the populiiclon co include only chose student* In the 
Z-Popul4iclon who cook QWcheiMC Ics In griide II ^* well other require- 
ment* reduced the nttmber of students In the swnple for the study to 1123* 
Hodt of the eo^lyses for the study were performed with this sample else* 

On the basis of the students* perfonrutnce on the criterion test, 
students were pisced Into six sblllty groups.. Three subtests of the cri- 
terion test were formed In order to obtain Information on students* t^r- 
fonnsnce In geometry, algebrSf and number properties 'tid relstlons* 
Ability groups were formed for each of the three subtests using the same 
procedure used for determining ability groups for the overall criterion 
test 

two main statlstltal models were Imployed to anslyze the data: uni- 
vsrlate anslysls of vsrlance and dlscrlmliuint analysis* The analysis of 
vsrlance was used to determine which of the concomitsnt variables, con- 
sidered sepsrately, dlscrlminste among ability groups at a significant 
level* Discriminant analyses were performed to determine which varlsbles 
discriminated *%est** among ability groups on the criterion test snd the 
three subtests with the effect of several varlsbles considered 
simultaneously* 

Three sets of ANOVAs were performed wltv the entire sample.. The 
first set Included one-way AKCVAs for each concomitsnt vsrlable with the 
criterion test scores as the factor with six levels* The second set In- 
cluded ANOVAs for a 4x4 factorial design with algebra and geometry sub- 
test scores as factors* These ANOVAs determined which variables discrim- 
inated among algebrs sblllty groups^ which discriminated among geometry 
sblllty groups, and the degree to which there wss Intersctlon between 
performances on these two subtests for each varlsble* The third set In- 
cluded ANOVAs for a 3x2 factorlsl design for esch varlsble with scores on 
the number subtest ss one factor snd sex as the other. These ANGVAs In- 
dicated which of the variables discriminate among ability groups for the 
number subtest.. Sex was used merely as a control varlsble.. The variables 
used In the dlscrimlnsnt analyses were chosen from among the vsrlsbles 
which indlcsted highly significant differences among ability groups ss s 
result of the series of ANOVAs, 



4. Findings 

The most slgnlflcsnt results csn be listed In terms of the strongest 
characteristics of successful Insightful mathematics problem solvers: 

<1) They performed higher on all of the mathematics achievement 
tests than did poorer problem solvers* 

(2) They did well In solving problems requiring considerable 
synthes Is .. 



49 



(3) Ittey w&re very proficient in solving «LgebrJtlc equmtioQ«. 

(4) Tttey performed high on verbal and general reasoning tests. 

(5) Tttey were good at determining spacl^l relaClonshlpa . 

<6) Ittey resisted distraction^ saw critical elemente^ and were 
field Independent . 

(7) They were divergent thinkers. 

(8) Tttey had positive attitudes toward mathematics. 

(9) Ittey viewed themselves as good mathematics students. 

(10) Their teachers had the most credits beyond the degree and 
had the highest degrees. 

(11) Itteir families h^d relatively high incomes. 

(12) Salaries were higher for beginning teachers in their communi- 
ties than salaries of teachers in the communities poorer problem 
solvers . 

(13) The population of their communities had recently changed. 

(14) Their socio-economic Index was about the same as that of poorer 
problem solvers. 



I n t e r Pr e ta tio ns 

The following Interpretations of the results were made: 

(1) Efforts to develop Insightful problem solving ability should 
Include exposing students to advanced toplcc In both algebra and 
geometry that involve ^ ^^^st deal of synthesis. 

(2) Solving routine algebraic equations helps to provide the neces- 
sary ''tools" for solving probleois . 

(3) Mathematics study which Is limited to acquiring only basic Ideas 
and skills Is not likely to produce proficient problem solvers. 

(4) Mathematics educators should not Ignore opportunities to enhance 
the development of reasoning ability. Teachers should be encouraged 
to provide experiences which challenge their students' reasoning 
ability. 

C5) Teachers may profit from the use of an approach to problem solv- 
ing similar to that prescribed by Polya. Such an approach might en* 
hance divergent thinking and students' ability to visualize spatial 
relationships . 
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(6) Th« d«v«LopDenc of poaicive student accicude* coward mMchematic* 
•houLd be an Inporcanc goal of c«*cher* concerned with developing 
problem solving dbilicy. 

(7) Expending effort co keep acudenca* eir/iromenc organized and or- 
derly nuiy Impede problem solving. 



The reaettrch reported In this acudy w«« the firac co be done by «otte- 
one other than the NLSMA research acaff end oonaulcants using the NLSMA 
d*c* benk. The research aerved the b»i* for the inve* cig* cor * • 
doctoral cheaia; chi* Report we* adapted frcM hi* cheai*. In aeveral 
reapecca, chi* research i* exemplary. The inveacigacor i* co be coeMended 
for having choaen «uch & aignificanc problem for hia doctoral cheaia. The 
rationale for the acudy^ the literature review^ end the deacripcion of rhe 
procedurea uaed are all excrevely well done. Alao, the reaearch deaign 
etkd the acaciscical anelysia cechniquea employed are moac appropriate, «nd 
the inveacigecor i* careful co point out variou* litnita ciona of the acudy. 
Thia abacraccor recossn^nda chia report aa a reference co peraon* inter- 
eaced in identifying variablea which are related co wtchenscical problem 
aolving. Hcwever, the dcudy doea have aome llmicaciona and ahorccominga . 

Probleoi aolving reaearch haa been nocorioua for the lack of con- 
aiacency of reaulca upon which co build a general theory of problem 
aolving. Thia ia due in pare to the face chac mo many different kinda of 
problem! heve been uaed from one reaearch «cudy co the next. The reader 
ahould bear in mind the nature of the problemi uaed in chia reaearch when 
attempting co generalise the reaulca co differenc kinda of problem* and 
beyond che populacion uaed in chia acudy. There ia alfo reaaon co believe 
chac aeveral of che problema are noc "inaighcful** problem! . The reader 
ahould look At che inveacigacor'a definicion of an inaighcful |nroblem and 
aample problems included on che cricerion ceac before deciding if che con- 
cluaiona drawn are appropriece. 

Perhapa che noac difficult caak for a probleo^ solving reaearcher 
liea wich incerprecing reaulca and drawing concluaiona. The overwhelming 
amounc of daca generaced by chiv acudy and che comiplexicy of che acaciaci*- 
cal modela employed made ic even more difficulc co make aenae ouc of che 
reaulca. Ic is evidenc in a few inacancea chac che invefcigacor had aome 
difficulcy incerprecing che resulca. For example, che auggeacion chac 
*'..• che aolucion of roucine algebraic equaciona ahould be atresaed co 
provide che neceaaary coola for solving problems (p. 106)" doea noc appear 
CO be baaed on che findinga of chis reaearch. In general, however, che 
incerprecaciona and conclusions are provided cauciously and only afcer 
choughtful refleccion. 

Finsllyt ic is encouraging co find divcrlminanc analysi* being used 
in machemacics educacion reaearch^ and uaed appropriacely. Far too liccle 
use ia made of thia and ocher mulcivariace scaciacical cechniquea co in<* 
vesclgace research problema involving aeveral variablea. 



Cricical CoMttentary 



Frank K. Leacer, Jr> 
Indiana Univeraicy 
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ED 084 133 

THE EFFECTS OfF DIFFERENT HA.THEMATICS CURRtCUtAJM OK SCIENOE ACHIEVEMENT 
IN SECONDARY SCHOOL* Bridghan, Robert C* NISMA Report Ho. 32 . 

Expanded Abstract ind Analysis Prepared Especially for I.M+E+ by William 
Fitzgerald, Michigan Scsce UniveraiCy 



1, Purpose 

To determine the effect* of uaing **iiew" and "traditional** mathematica 
curricultun m«terials on achievement in science aa mesaured by the College 
Board Teat in Biology, Chemistry and Physica* 



2, Rationale 

'^ * * a fuller evaluation of curricula in mathematics would consider 
not only achievenient in msthona tics , but in the sciences » well. 

One *aide effect* of the new curriculs in mathematics ^ their effect 
On achievement in the sciences ^ is the focua of the study reported here. 
Achievement in the sciences is clearly outside the primary target area 
of the new mathematica curricula «nd is more obviously related to other 
factors, such aa the substance and effectiveneaa of acience teaching* An 
effect of different curricula in mathetnatics on achievement in the sciences 
is likely to be small and eluaive. If one were found, however, it would 
provide a substantial argument for or ag«in«t the use of new curricular 
materials in mathematics, since it would suggest a difference in the 
transfer ability of the students* mathematical competence to other areaa 
of thought and action,** 



3, Research Design and Procedure 

The study was conducted on those students frooi the Y-population who 
took the College Board Examinationa in Biology, Chemistry or Physics and 
for whom complete data were available. The sizes of the groups taking 
the exams were 426 in Biology, 5o5 in Chemistry and 22g in Physics* 

The data which were available included scores from the achievetnent 
and aptitude teats from the seventh and eighth grade, sex, median income, 
years of ma theciatics , and the proportion of the mathematics curriculum 
that was traditional^ 

'IMthough a correlational analyais was used in the study, prediction 
of the College Board achievement held only secondary intereat. Rather, 
partial correlations were used to determine whether the type of mathe- 
matics curriculum experienced by the students was related to science 
achievenwnt after the effects of student input were accounted for+ Thus^ 
in each analyaia, student aptitude and achievement were partialled out 
first, Chen sex and the exonomic index^ and finally the number of yeara 
of mathematica completed." (P-^) 
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When none of the other vtritbLct trc ptrtitLLcd out of the •ntLyti«» 
the corrcLttiotift b«twft«n the proportion of tr«ditiontL outhemtict 
•tudicd and the tcoret on the biology* chcinittry ttfed phytict cx«ms wer« 
-.20, -.24 •nd -,22 (p <^ .05, .01* ^0L>. Ih«t« corrcLttion* remained 
•ignifictnt tftcr ptrti«LLing out junior high tchooL •chiev««ent •corct 
•Tid tcx. However, in •!! thete ctt»> the corrcLttiont dropped benetth 

• ifnifictncc vhen the effluence of the ttudentt cooiminity wet controlled*. 
When the economic index wet not considered in the •ntlytit^ tnd the 
other vtritblet were controlled, the correlttiont were -^.13, -,15 tnd 
-,22 (p <^ .05, .01, .01), 

There it • brief ditcuation tbout the predictability of junior high 

• chool data on the College Board Exemina tiona . 



5. Inter ore tationa 

The author coimncnta; "The partial correlationa iiMlicate that atu* 
denta "^oae aecondary luthemetica curriculum waa nore modem tend to heve 
hi||her echiev^mant in the aciencea, Ihe correlationa are not large* and 
the effecta they auggeat are not great* but conaidering their conaiatency 
aiMl the likelihood of fiTiding no effect at all, they iiidicate an Inpor* 
tant edge for the "new" curricular meteriala in methemetica. Collaotively* 
the reaulta auggeat that the luthemetical competence gained by atudent«i 
In their atudiea in the aecondary achool are aomcwhat oMre tranaferable 
to other contexta* auch ea thoae aaaociated with learning and problem 
aolving In the aciencea, if the atudenta* curriculum ia more modarn. 

''Theae reaulta are a traight forward and conaiatent. But the picture 
changea markedly if the affluence of a atudent*a coenunity ia taken into 
account. When coonunity affluence ia partielled out along vith the other 
input veriablea, the correlationa between type of mathemetica curriculum 
and icience achievemeiit drop markedly. All of the reaidual partial cor- 
relationa (r * -.09 for phyaica, r ■ -.04 for chemiatry* and 4 « -.09 for 
biology) leek atatiatical or practical aignificance. 

*Vhat can be aaid, then* of the effect of type of methematica curric- 
ulum that aeeme ao cleer when connunity affluenca ia ignored? Kow the 
inference to be made ia not at all clear. The problem ia, at root* chat 
type of methcmatica curriculum and coomiunity affluence tend to be aaaoc- 
iated. Ia the apperent ef f^ctiveneaa of the more modem mathematica 
curricula only illuaion, a miataking of effecta really due to cotmun- 
ity wealth on College Board achievement acorea in the aciencea? Ko choice 
between theae optiona ia Verranted by the data In hand, 

''The available data provide aome comfort to thoae who have eapcuaed 
the new methcmatica; if there ia tn effect, it favora atudenta who h«v« 
had more of the *new math*. Whether the data apeake of a curriculum 
effect or only of the Importance of a atudent *a comunity it unclear* how- 
ever. It aecme likely that, given the aiie of the proapective affect, aiid 
the difficulty of diaentangling cosnunity and curriculum factora in one 
of *neture*a experloenta,* only a true (and rather large) experiment will 



60 




be capable of determining whether the type of jnathematics curriculum stu- 
dents experience re&lly does have en effect <m their achieveioent in 
•cience." (p. 12) 



Criticel Coiamentery 

The study wss obviously carefully done and represents a clever use 
of existing dsts to snswer some interesting questions. 

It is probsbly ssking too much to expect the content snd emphseis 
of s textbook to have s very significsnt effect on student schievement 
wh«n other fsctors such ss the tescher*s perception of his role in the 
clsssroom are ignored. 

It would be interesting to ask the complementsry question of how 
does the study of science affect the learning of mathematica or hew do 
the interactiona of msthemstics and its spplications affect the learning 
of both. 

Villism M. Fitzgerald 
Michigan State Univeraity 
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MATBEMATICS EJJUCATIQH RESEARCH STUDIK REPORTED IN RESEARCH IN EDUCATION 

April - June 1975 



ED 099 204 Hewlett, Kenneth Etonn, A Study of ttie ReLitiontbiP Between 
Pligatlan Cleaa Inclueion Taeka etwi the Ability of Firet Grede 
Children to Do Miajing Addend CbttPutetion and Verbtl ProblMW , 
108p, Not eviiUble from BCRS. Aveil;ible froa Unlvereity 
Microfilm! (74-8376). 

ED 099 205 AkkertiulSt Gererd. A C<wrleoti of Pu&ll Achleveaent end 
PuPil AMiltudee with mad without the Aiiletince of Betch Cottpu- 
ter-SoPPorted Instruction , 77|>. Not ev«lUble front ELKS. 
Av«lUble from Unlverelty Mlcroflloie (74*9052). 

ED 099 238 Foulsen, Sten C, Study fiVI 11a and tUthwMtlce Achievement. 
Report Ho. 2 . 28|>, MP «nd HC tv«ll«ble from KDRS. 

ED 099 415 Sc«rd«n»ll«t M«rlene, Mental Proceeeina AtPecU of Two 
Formel Q&eretlOBel ^aeke: A Developqwptal In^eetlgetlon of m 
Quentl£jiUvft Heo-Plegetlen Model , lip, MF «nd HC evellible 
from EDRS, 

ED 099 716 H«rtl«ge, P«trlcle L* ; H^rtUge, Lawrence C. CUeeroom 

Corr*l^t*>e of Heurologlcel "Soft Slgna" , 9p. MF end HC ivell- 
«bl« from EDRS , 

ED 100 516 Meicham^ Merle L, AH Thoee Independent Varlablee , 23p. 
HP end HC evilleble from EDRS, 

ED 100 705 Hill«rt P«tty L* ; Phllllp4t E. Raj. Developntent of m 
Leemlng Hierarchy for the Computet Ion el Skllle of Rational 
Number Subtraction , 13p. HF «nd HC evell«ble froot EDftS. 

ED 100 718 Z«leveklt Don«ld L, An Exploratory Study to Compare Two 

Performance Meaaurea; An Integyley-Codlnft Sch^ata of Mathematical 

Problem Solving and a Written Teat. P»rt 1, technical fteoort 
Ho. 306 , 99p, MP and HC available from EDRS. 

ED 100 719 Zelevakl^ Donald L, An Exploratory Study to Cowptre TMo 
Performance Meaaurea; An Interview^ Cod Irti Scheme of Mathemat- 
ical Problem Solvlnft and e Written t*et. Part 2. Technical 
Report Ho. 306 . 125p, HF And HC available ftom EDRS. 

ED 100 963, Tripp, Laurence I^; And Otbera. An Exploration of Specific 
Tranafer Propertlea of D^fferept Inatructlmtal Sequencea Dt^ 
aigned for Uae In Teaching Selected Prlnclp^la of Conditional 
Logic , 22p, MF and HC available from EDKS, 

ED 101 017 Ozenne^ Dan ; And Othara. Achl»yement Tfaat Reatandard- 
leatlon: Enwrgancy School Aid ActTgSM) HatJmijl Eval uation, 
I36p. MF and HC available from EDRS. 
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ID 101 473 0*R«illy, Robert. cUfroona climate *nd Achi<vCTgnt In 
SecottdTT School M«i-h*m*i-ica C1m«< . 18p- MF HC «v<ll- 
abl« from EDRS> 

ED 101 957 Hltchel«u>r<t Hichael Development and Validatiop of th< 
Solid RgPTeaeBt!<tioii Teat in ■ Cro<<-8ectioiKl 3<»Ple of 
jMelcift Studenta . 20p+ MP «nd HC available frodi EDK3> 

ED 101 993 tUrlin, Herbert. Evaluation ReSort 1-A-l; Oycrview. 

Dealitn and Inatrumentatiqn . 42p. Hot available from EDftS. 
Available froa CEWEL, Inc.; ERic/SHEAC (on loan). 

ED 101 994 Herbert, tUrtin. Evaluation Report l-A-2; External Review 
of CSMP Materiala . 36p> Hot available from E[»S> Available 
frodi CKMtEL, Inc.; ERic/SMEAC (on loan). 

ED 101 995. HoIe, Alan; And Othera. EveXuetion Report l-B^l; Mid- 
Year Teat Data; cSMP Pirat Grade Content . 60p. Hot avail-* 
able from EDRS. Available from CBMtEL^ Inc.; ERIC/SHBAC (on 
loan) . 

ED 101 996 Karmoa, Joaeph S. EvaluaU^on Rfefiort 1-6*2: End-of-Tear 

Teat Data; CSMP Pirat Grade Content . 72p- Hot available from 
EDRS. Available from CEHREL, Inc.; ERIC/SKEAC (on loan). 

ED 101 997 Martin, Herberts And Othera. Evaluation Report 1-B*3: 
End-of-Year T^at Data; Standard Pirat Grade Content . 81p. 
Hot available from EDRS. Available from CEHtEL^ Inc.; ERic/ 
SMEAC (on loan). 

ED 101 998 Martin, Herbert; And Othera. Evaluation Report 1-6*41 

End-of-Year Teat Data; CSMP Kindergarten Content . 36p. Hot 
available from EDRS. Available from CCMREL^ Inc.; ERic/SMEAC 
(on loan). 

ED 101 999 Martin, Herbert; And Other*. Evaluation RcPort l-B-5: 
Tfeat Data on Some General Co&nitive Skill* Relatad to CSMP 
Content . 49p> Hot available from E[»S. Available from 
CE*ML, Inc.! ERIC/SMEAC (on loan) - 

ED 102 000 Martin^ Herbert; And Othera. Evaluation Report l-tt-6; 

Sunmanr Teat Data: Detroit School* . 29p. Hot available from 
EDRS. Available from CBMREL, Inc.; ERlC/SMEAC (on loan). 

ED 102 001 Kannoa> Joaeph S.; And Other*. Evaluation Report 1-C-l; 
Teacher Training Report . ?2p. Hot available from EDRS. 
Available from CEHREL, Inc.; ERIC/SMEAC (on loan). 

ED 102 002 HoIe, Alan; And Other*. Evaluation Report l-C-2; Ob*er- 
vation of CSMP Fir*t Grade ciasaea , 62pv Not available from 
EDRS. Available from CEHREL^ Inc.; ERic/SMEAC (on loan). 

ED 102 003 Herbert, Martin; And Other*. EvaluaHfin Report l"C-3; 

Mid-Year Data from Teacher Queationnaire* . Hot available from 
EDRS> Available from CEMREL, Inc.; ERIC/SMEAC (on loan)> 
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?D 102 004 Holi, AU«; And Others. Eviluatlon Report l"C-4t gnd*of- 
Ye<r T>^t^ from Tfescher Que< tlontt^ilres . 89p. Not aviillable from 
EtES+ Av«ll<ble £ro« CEWtIL, Inc.; BRIC/SKEAC (oo lo«w). 



ED 102 005 HoIe, Alan; A«d Other*. Evlmttott Report l'-C-5: Inter^ 
vleva vlth OSMP Klttdetg^irtett Teachers . 117p, Mot *v«ll<ble 
from EDRS+ Available from CEMREL, Inc*; ERIC/SHEAC (on loan). 

ED 102 006 BaraECE, Edv<rd; Martin, Herbert. Evaluation Report l-C-6; 
Analvaia of Teacher Log^ . 64p. Kot <v4illable from EiHtS> 
Available from CEHREL, Inc.; ERIC/SHEAC ion loan). 

ED 102 024 Godfrey^ Leon D. A Study of the Rote- Conceptual <ind Recep- 
tion- Dl a cover y Dlmenalona of Learning M<thc«atlcal Concepta. 
Part 1. Technical RePort Ho. 307 . 85p. MP and He evallable 
from EDRS. 

ED 102 025 Godfrey, Leon D. A Study of the Rote-ConcePtual end Recep- 
tion- Dl a cove ry Dlwenalona oE Learning Matheiroatlcal Conccpta . 
Part 2* Technical Report No. 307. 129p. MP end HC available 
£rom EDRS . 

ED 102 029 Hath Fundainental^J Selected R^aulta from the Flrat 

national Aaaeaament of Hathematlca , 56p. MP and hC available 

from EDRS . 
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MMmmTlCS GDUCATIOM research studies KEPORTED in JOumiJS AS INDEXED Bcr 
CURRENT INDEX TO JOURIUOS IN EDUCATION 
AptLL - Jun« L975 



ej 107 794 FennftttA, ELLzMbeth. "Sex DLffetencea Ln HfttheaMtLcM 

teamLng: Why???*' Elwaentiry School Journil . v75 n3^ppl83-l90^ 
Dec 74. 

ej 107 809 Dr«Lnetdt Gh«tle« J. 'Inducing OrdLnal Mod CAtdLnal K«p- 
te«ent«tLon« of the FLr«t Five lUtutal Numbeta.** Journal of 
ExPcrlmeptil Child Fiychology . vl8 n3^ pp520-534^ Dec 74. 

EJ 108 002 Webb, Leland P.; ShettiU, >Uje« 'The Effect* of 

Differing Preaent«tion« of H«theiimtic«l Word PtoblftoM Upon the 
Achievement of Preservice ElewntAry Te«cher«.** School Science 
ind >totbero*ticg * v74 n7 ^ pp559-565j Nov 74. 

EJ 108 007 Wollnuin^ V«tten; K«tplu«, Robert. 'Intellectual Develop- 
vtent Beyond Blement«iry School V; U«ing R^tio iit Differing 
Ta«k9." School Science ^nd Mathemttca . v74 n7^ pp593-613, 
Nov 74. 

EJ 108 229 HarriA, >Ury B.; Liguori, R«lph A. *^ome Effects of « 

Personalized Syatein of In«truction in Teaching College H«the- 
mtics,** Journal of Educitiopil Re>eirch . v68 ti2» pp62-66j 
Oct 74. 

EJ 108 374 Ehrenpreis, Walter; Scandura^ Joaeph H. *'Ihe Algorithmic 
Approach to Gurrlculttm Construction; A Field Test In Hathe- 
matic»." Journal of Educational PaYchologY . v66 n4, pp491-498» 
Aug 74, 

EJ 109 775 ColIiBj Kevin F. **The Development of a Preference 

Logical Conaistency in School Hathematica Child Development > 
v45 n4^ pp972-977^ Dec 74. 

EJ 109 955 Carpenter^ Thomas ^'Heasurement Concepta of Pirat- And 
Second-Grade Students,** Journal for Reaearch tn Mathematics 
Education , v6 nl^ pp3-13, Jan 75. 

EJ 109 956 Leater^ Frank K. *'Developmental Aspects of Children's 

Ability to Underatand Mathematical Proof.** Journal for Reaearch 
In Mathematics Education , v6 nl^ ppl4-25j Jan 75. 

EJ 109 957 Gregory^ John W, ; Osborne» Alan R- '*Logical Reasoning 
Ability and Teacher Verbal Behavior Within the Mathematica 
Classroom, ** Journal for Reaearch in Mathematica Education ^ 
v6 nl, pp26'36, Jan 75. 

EJ 109 958 Hancock, Robert R. **Cognitive Factora «nd Their Interac- 
tion with Inatructional Mode.*' Journal for Reaearch in Mathe- 
matics Education , v6 nl, pp37-50, Jan 75. 
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EJ 109 ^59 Fusofii Kar^n* 'Th* Effect* on Preaervice Elementary 

Teacher* of Learning H^thematic* and He*B* of Teaching Hethe- 
metic* Through the Active Henipulation of HateriaU*** Journtl 
for Re<e<rch in M^thw—ticjL Education * v6 nl^ pp51-63i J<n 75.. 

EJ 111 029 Becker* Shell*. '*The Performance of ite«f and Hearing 

Children on • Logical Discovery T<«k.*' Volt^ Review ^ v76 n9i 
pp530-536, Dec 74, 

EJ 111 439 dtonji, M. 0. 'The Development of Logical Thinking In 
Preachool Zenbiaa Children: ClM*ific*tion/* Journal of 
Genetic Psycbologv ^ vl25 n2, pp247-256, Dec 74. 

EJ 111 534 Hademenoa, Jame* G. **A Comparative Stivdy of Piaget-Type 
Cofiaervation Taaka," School Science and Mathereetica i v74 niO, 
pp680-686> Dec 74. 
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Ihe NLSHil Reports 



Ihe 32 report* of the NjtLonjl LongLtudLn^l Study of HathemmtLcjl 
AbLlLtLes <Nos. 1-28 mM 30-33), were pubUihed by the School Hathem«tLc* 
Study Group. VhLl« the reports h^ve all been liated in CRIC'* Re<oyrce< 
In Education ) none are jt this time available from the ERIC Oociunemt Re- 
production service. Ihey are, hovever, available on a loan faasi* from 
the ERIC Information Ana!ysis Center for Science^ H«thematice «nd Cnvi- 
roivMiit^l Education. Ihe Reports may also be purch^ased from: 

A- C. Vroiii«n> Inc. 

2085 East Foothill Boulevard 

PasAdens^ California 91109 

All 32 reports are listed on the folloving pages> with a brief annotation. 



Wilson^ Jam^s W. ; Cshen> Leonard 5.; and Begle^ Edward 6. (Eds.) HLSMA 
Report No. 1, Parts A and X-Population Test Batteries . 1968. 
505p. Part A» $1-62; Part 91.63. (ERIC: ED 044 277, SE 009 436) 

Contains most of the tests administered to fourth graders at the start 
of the study in 1962. 

tfllson, James tf . ; Cahen, Leonard S.; and Begle, Edward G* (Eds.) KLSMA 
Report No. 2, Parts A and B, Y-Population Test Batteries . 1968. 
553p. Psrt A, $1*62; Part B, $1,63. (ERIC; ED 044 278, SE 009 437) 

Contains most of the tests administered to seventh graders at the 
start of the study in 1^62* 

Wilson, James V,; Cahen, Leonard 5,; and Begle> Edward G, (Eds.) ULSMA 
I^ort No. 3, ^'Population Tftst Batteries . 1968, 336p, $2.00, 
(ERIC: ED 044 279, SE 009 438) 

Contains most o£ >-he tests administered to tenth graders at the start 
of the study in 196:>. 

Wilson^ Janws W.; Cahen^ Leonard 5.; end Begle, Edward G* (Eda.) KLSM A 
Report No. 4, Description and Statistical Propertiea of X-PopulatTon 
Scales , 1968, 248p, Si. 50. (ERIC: ED 044 280, SE 009 439) 

Contains descriptions and statistical properties of test scales used 
with students In grades 4 through 8- Each scale, designed to meas^ 
ure a apeclfied content Oi psychological area, ia briefly identified 
and described, example iteni3 are given, and statistical information 
is listed for the acale and items from a 5 percent stratified random 
sample of the total HLSMA X-Populatlon. 

Wilson, Jamea V.; Cahen, Leonard 5,; and Begle, Edward G, (Eds.) JQ^kUl 
Bpport Ho, 5. Descrtptjon and fi^J^f^^^rJ^ Prr.n^rH*it nf Y>Pooula- 
tion Scales . 1968, 326p, Si. 50. (ERIC: ED 044 310, SE OlO 181) 
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CoQt4iiQt dctcriptiotii ind ttiitittictl prop«rti<t of tctt uted 
wich ttudCDtt in fttdct 7 txvA 8* l4ich tciiLe, dc^igntd to m«4itiitc • 
• pccificd content or ptychoLogictL ttcii, !• briefly identified end 
deectibed> exemple items et« given* end etetieticel infom^tiaft it 
Lifted for thct ecele end items from e 5 percent etretified rendoo 
estipLe of the totel Nt^HA Y-PopuUtion. 

tfileon, Jemee tf- ; Cehen> Leoiurd S.; end B«sLc, Edverd G. (ffde.) If MMA 
Rej>ort Ko, 6* Peecription end Stetieticel Propertiee of Z-FoPulstion 
Se e lee , 196S. 188p. 91.50. (ERIC: U 044 2S1» 81 009 440) 

Conteine deecriptione end etetieticel properties of teet ecelee used 
vith etudente in gredee 10 through 12. lech ecele, deeigned to a^ee* 
lire e epecified content or peychologicel eree, ie briefly identified 
end deecrib«d, exestple itens ere given* end etetieticel informetioft 
is lieted for the ecele end items fron e 5 percent etretified rendon 
esnple of the totel HISHA Z*FOpiilstion. 

ftonberg* Ihomae A- end tfileon, Jeoee H- HLSma Report Ho, 7. The Develop- 
went of T^ete , 1969. 391p. $2.50, (ERIC: ED 084 112, 8E 016 669) 

Deecribee the proceeeee used for deciding vhet ehould be meeeured* 
when* end how. Work of the SHSG Penel on T«ete for collecting teet 
items, cone eptue lilting ecelee^ pilot teeting* snd snslyiflng pilot 
test dste is reviewed. Ihs developnwnt of e model for uthemitice 
echievenent> vhich cleeeifiee teet ecelee by methemstice content end 
levele of cognitive behevior^ ie diecussed. Procedures for ths de* 
velopment of the fsll snd spring bstteriee for eech of the five 
yeere of the etudy ere deteiled. Ih6 eelection end development of 
cognitive proceeeee teete> ettitude inetrumente end role incventoriee 
ere eleo included* end the development of the echedulc for peycho* 
logicel teeting ie deecribed. Reporte of the Firet snd Second Con- 
ferences on Teete snd e lieting of the NLSHA 8celee on Tepe ere in- 
cluded ee eppendices. 

Wilson* JeiPee tf . ; Cahen* Leonerd S.; end Begle* Edwsrd G. (Eds.) HL3MA 
Report Ho, 8^ Ststistiicsl Procedures snd Coroputgr Progrsmi . 1972. 
l2i^. $3.00. (ERIC: ED 084 113, 8E 016 670) 

Discussion of meny of the progrsnis from the SMSG Computer Progrsm Li- 
brsry es it exieted in June* 1972. Major progrsme included involve 
item enelysie, ettitude item enelysie* ecele ecoring* correlation snd 
t-test, stspwise regreesion* homogeneity of regreeeion* snd fsctor 
snsiysis. Besidee e diecussion of eech* information on parameter 
eet*up along with eample input end eemplc output ie given. Actual 
line-by*line progrem lietinge ere not included. However* a conclude- 
ing enelyeie paper expleine the use of the program library and givee 
the call name and function for eech aveileble progrem. 

Wileon, Jamee tf . ; Cehen* Leonerd S.; end Begle* Edverd G. (Ede.) KLSMA 
Report Ho. 9. Hon-Teet Dete. 1968. 139p. (ERIC: ED 044 282* 
SE 009 441> ,^ . 
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Identifies the variables which have been formed from the non-test 
data collected in HlSK^t presenting a comprehensive description of 
the KtiSHA population In contexts other than mathematics achievement 
and psychological characteristics. Data were included on school-^ 
community charac terlst Ics » curriculum patterns, and geographic distri- 
bution. Ihe report Is intended as a ri^^ference for the study and 
should used in conjunction with the preceding eight NI^HA reports* 

Carry, L* R,^y and Weaver, J* Fred. HLSHA Report No> IQj. Patterna of Mathe- 
matics Achievement in Grades 4, 5, and 6; X' Population . 1969 . 210p* 
$2*00. (ERIC: ED 044 283, SE 009 442) 

Identifies differential patterns of mathematics achievement which could 
be ascribed to different mathematics textbook series used by groups of 
pupils over a three-year span covering grades 4, 5, and 6. Compari* 
sons are presented for six textbook, series measures of mathe- 

matics achievement > 

Carry, Ray. HLSMA Re&ort Ho> U, Patterns of Mathematics Achievement 

in Grades 7 and 8: X-Popula tlon > 1970. 190p. $1,50. (ERIC: ED 045 
447, SE 010 447) 

Identifies differential patterns of mathematics achievement which 
could be ascribed to different mathematics textbook series used by 
groups of students over a two-year span. Comparisons are made 
eight textbook groups at the end of grade 7, at che beflinnlng of 
grade 8, and at the end of grade 8, Forty*one measures of mathemati- 
cal achievement, were used as dependent variables.. 

McLeod, Gordon K> and Kilpatrickt Jeremiy. NLSMA Report Ho> 12* Pat^urna of 
Mathematics Achievement In Grades 7 and 8: Y- Population . 1969. 148p. 
51.50. (ERIC: ED 084 114, SE 016 ^71) 

Considers comparisons made for the Y-Populatlon from achievement test 
data collected at the end of grade 7 and again at the end of grade 8. 
TWenty-seven measures of mathematical achievement were used as depen- 
dent variables < 

Kllpatrickt Jeremy and McLeod> Gordon HL9MA RePort Ho. 13j— Efttterna of 
Mathematics Achievement in Grade 9: Y-PoPulatlon . 1971^ lOlp. 5 1 . 50 . 
(ERIC; ED 084 115, SE 016 672) 

Considers comparlaons made for the Y*Population from achievement test 
data collected at the end of grade 9 and again at the beginning of 
grade 10< Only the two-thirds of the population using a first-year 
algebra textbook are Included in this study. Thirteen meaaures of 
mathematical achievement were used as dependent variables.. 

McLeod, Gordon ai^d Kilpatrick, Jeremy.. HLSMA Report No> 14) Patterns 
of Mathamatica Achievement in Grade 10: Y-Populatlon . 1971. I09p. 
$1.50. (ERIC: ED 084 116, SE 016 673) 

Conaidera comparlaons made for the Y-Populatlon from achievement test 
data collected at the end of grade 10 and again at the beginning of 
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grade 11* Only the approximately 60 j>ercent of the population that 
completed a geometry course In grade 10 are Included In this study* 
Ten geometry scales^ concentrating on hlgher-^ievel skills than are 
u5ual In achievement ceating^ were used as dependent variables. 

Kllpatrickj Jeremy and McLeodt Gordon K* fTfiTi A RePort No* 15^ Patterns 
of Mathematics Achievement In Grade lli TC- Population * 1971. 91p * 
$1.50. (ERICj ED 08^ 117, SE 016 674) 

Considers comparisons made for the TC-Populatlon from achievement test 
data collected at the end of grade 11* Only the approximately 45 per- 
cent of the original population that had conrpleted beginning algebra, 
geometry, and advanced algebra are included in this study. iVelve 
mathematics content scales^ appropriate co all three courses, were 
used the dependent variables* 

Wilson, James W. NLSMA Report No. 16, Patterns of Mathematics Achieve- 
ment in Grade 10; Z- Population ^ 1972* I15p. $1.50. <ERtC: ED 084 
118, SE 016 675) 

Considers comparisons made for the Z^Population from acbiev^iment test 
data collected at the end of grade 10* Only the approximately 80 
percent of the original population that completed a one-year course 
in plane geometry are included In this study. Seven mathematics con- 
tent scales, rather than a "geometry testt" were used as the depen- 
dent variables * 

Wilson, James W* KISMA Report No* 17^ Patterns of Mathematics Achievement 
in Grade II: Z- Population * 1972* 78p. $1.50* (ERICj ED 08A 119, 
SE 016 676) 

Considers comparisons made for the Z-Population from achievement teat 
data collected at the end of ^rade 11. Only the large portion of the 
original population that completed a second-year algebra or interme* 
dlate mathematics course in this year are included in the study* Ten 
scales, designed co sample the range of mathematics achievement after 
three years of college preparatory mathematicSf were uaed as the de- 
pendent variables. 

Romberg, Thomas A. and Wilson, James W. NljMA Report No* 18, PatCerns of 

Mathematics Achievement in Grade 12; Z^PoPulatlon * 1972^ 78p* 5l*50 
(ERICj ED 084 120, SE 016 677) 



Considers comparisons made for the Z-Populatlon from achievement test 
data collected at the end of grade 12* TWo different types of com- 
parisons were petformed; comparisons between differe^nt types of cur* 
ricula and comparisons between textbook groups within a particular 
Curricula* Ten mathematical scales, associated with topics important 
in most of the curriculttm groups, «rere used as the dependent varl-- 
ables . Questions of significance are discussed separately for the 
various conditions of the analyses* 

Travers, Kenneth j, HIS MA RePort No. lSL>_-Non-Intellective Correlates of 
Under- and Overacbievement in Grades 4 and 6 * 1971* 330p. $2.00. 
(ERIC: ED 084 121, SE 016 678) 
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Pr»eQt* a aequAnce of •n*Ly«es that explore the reletLonetiLpe bfttwedn 
nmthenuitLce AchLftvement end threft set* of verLebLee: pupLLi teecheri 
end school for students Ln grade* 4 and 6* Achievement crLterLe used 
were coraputetLon, etructure. end • stenderdLsed teet^ No exten#lve 
• tterapt wee nede to interpret the dete.. 

CrosewhLte) P. Joe. HLSMA ttePort Ho. 20^ Correletaa of Attttudee toward 
tUthewjtice. 1972. lllp. $1.50. (ERIC: ED 084 122, SE 016 679) 

ExenLnea neaaurea of attitude, self-concepti and anxiety aa outcomea 
of matheiutica inatruction for students in gradea 4 through 12. 
Specific area analysed were (l) grade distribution and atability of 
attitudes^ <2) patterna of intercorrelation among attitude variableai 
(3) correlation of attitude with achievement profilea for aex and 
textbook group** Ihe attitude* aelf-concept* and anxiety acales are 
included in the document. 

Vilaon, Jtnea W. and Beglei Edward G. (Eda.) H1£MA Report Ho. 2L.. girta 
A> B and Cj Correlates of Mathepatica Achievementi Attitude and Role 
Variables . 1972. l,453p. P*rt A, *2.50; P*rt ?2.50; Part C* 
$2.50* (ERIC: ED 084 123. SE 016 680) 

Contains the correlatea claaaified aa attitude and role variablea for 
atudents in Shades 4 through) 12. Almoat all of the three parte of 
the report consiat of the descriptive atatistica and the two-way 
analyaia of variance for each classification variable by achievement 
variable pair^ for each sex x textbook sample where significance waa 
reached. Ho interpretation of the reaults is given. Ihe report ia 
intended to serve aa a reference for further inquiry. 

Vilson. Ja«ea W. and Begle, Edward G. (Eda.) HLSMA Report Ho. 22^ Ptrta 
A, B and c. correUtea of Mathematics Achievementi Cognitive Vari- 
ables . 1972. l,485p. Part A, $2.50; Pait B, $2.50; Part C, $2.50. 
(ERIC: ED 084 124, SE 016 681) 

Containa the data on correlates claaaified «s cognitive variablea for 
atudents in grades 4 through 12. Almost all of the three parte of 
the report conaist of the deacriptive statiatica and the two-analysia 
of variance for each claaaification variable by achievement variable 
pair) for each aex x textbook sl pie where significance waa reached* 
Ho interpretation of the reaulta ia given* Ihe report is intended to 
serve «s a reference for further inquiry. 



Vilaon, J«mea and Begle* Edward G. <Edi.) HLSm Report Ho. 23. Parte 

A. B and C, Correlatea of Mathematica Achievementi Teacher Back- 
ground and Opinion Variablea * 1972. l,399p. Part A, $2.50; P*rt 

B, $2.50; Part C^ $2.50. (ERIC: ED 084 125, SE 016 682) 

Contains the i^'ta on correlates claaaified as teacher background «nd 
opinlou variablea for gradera 4 through 12. Almoat all of the three 
parte of the report conaiat of the deacriptive statiatica and the 
two-way analyaia of variance aaaociated with each claaaification var- 
iable by achievement variable peir# for each eex x textbook a«iple 
where aignificant waa reached. Ho interpretation of the reaulta ia 
given. 
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tflLtont J«OMt tf. tnd B^gLe^ Edv«rd (Edt.) KLSMA Raport Uo. 24, Parf 
■ A* C and Correltt« of tUth^n*tict Achiev^nenti School-Co^u- 
nity gnd PcmogriPhlc Variablet . 1972. L,dd3p. Pirt A, $2.50; Ptrt 
A^ $2.50; Pirt $2.50; Part C, $2.50, Pirt D, $2.50. (ERIC: ED 084 
126, SE 016 683) 

Contains the d«tt on correl«tet cltttifLftd •• tchool-coiiiiiunity tnd 
denogrtphLc v«rLablet for ttudentt in gtadet 4 through 12. Alnott 
all of thft four parta of the report conaLat of the deacriptLve 
atetiatica and the two-way enalyaLa of variance aaaocLated with eech 
claaal£ication-vari«ble-by achieve«ent""variablV"piir^for 
textbook awnple where aignificance w«a reached. Ho interpretation 
of the data ie given. The report ia intended to aerve aa • reference 
for further inquiry. 

Wilson, Jenea tf. and fegle, Edward G. (Eda.) HI^ Repori- Mn. 25, P«rf 
A.. B and C* Corr^letea of M«theaatica Achievement i Teacher Aaaiftned 
Gredea . 1972. l,367p. p«rt A, $2.50; Pert 52.50; Part C, $2.50. 
(ERIC: ED 084 127, SE 016 684) 

Containa the deta on correlatea claaaified aa teacher-aaaigned gredea 
for atudenta in gredea 4 throas^ 12. Almoat all of the three perta 
of the report conaiat of the deacriptive atatiatica and the fcwo-wey 
anxlyaia of variance aaaociated with each claaaificetlon variable by 
achievement variable peir^ for each sex x textbook aemple where aig- 
nificance waa reached, no Interpretation of the reaalta ia given. 
The report ia intended to serve aa a reference for further inquiry. 

tfilaont Jemea tf. and Begle, Edward G. (Ede.) NLSHA Report Ko. 26. Corre- 
lates of Methemetica Achieveroenti Sudamery . 1972. 213p. $2.00. 
(ERIC: ED 084 128, SE 016 685) 

A aurvnery of NLSHA Reporta Ifoa. 21*25t preaented aa en aid in search- 
ing for patterna across various correlatea, varioaa mathenetical 
echievetnent oeaaurea, end various samples, in the originsl enslyses, 
students were grouped into three ability levels and poaaible corre- 
lates were considered ss c lasaification variablea: the reaulting data 
were conaidered through a two-way analyaia of variance. Findinga are 
presented in the form of individual, 2x2 matricea for each aet of 
variablea. Ko attempt is made to interpret the results. The report 
is intended to serve ss a resource document to suggest hypotheses snd 
furt her lines of inquirjfj ^.^^ .^.-..^ — 

Begle, Edwsrd G. KLSMA RePort Ko. 27< The Prediction of Hsthematics 

Achievflment . 1972. IWp. $2.00 (ERIC! ED 084 129, SE 016 6^6) 

Discusses the attempts to determine which of many variables hud sig- 
nificant predictive po^er for atudent achievement on varioua mathe- 
matical acales* A stepwise regreaaiou enalysia with e three^^stsge 
elimination waa used to identify the beat predictors, in the firat 
series of enalvsesii most of the significsnt predictors were 
mathematical scales. A second series wss used to determine the best 
psychological predictors. Finally, the mathemstlcsl end psychological 
predictors are merged ^nd the total results presented. 
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Begle, Edward G* and Geealin, Willi«m Edward. NLSHA Report Ho. 28. Teacher 
Effectiveness in MatheTnatics Instruction . 1972. 146p , S2.00* (ERIC: 
ED OaA 130, SE 016 687) 

Concentrates on the analysis of the relationship between teacher char- 
acteristics and student achievement in the first year of the X- , Y- > 
and Z-Popul«tions (stu<Jents in grades 4, 7 and 10) and in the second 
year of the X- and Y- Populations (students in grades 5 and S) . A re- 
gression analysis approach was used to study teacher effectiveness 
with tea-pe c t— to-^-<imputa-tion-a nd— t^ctjmpreh e ns-ton— separate ly^ — " 

Branca, Hicholas A* NLSHA Report Ho* 30, Follow-uP Study of tJLSHA Z-Popu- 
lation . 1972* 143p . $2.00. (ERIC: ED 084 131, SE OU 688) 

An analysis of a follow-up survey conducted on the Z-Population 
approximately one year after the students completed grade 12* Stu- 
dents were grotiped according to type of mathematics textbooks used 
and an extended series of Chi-s<|iiare analyses performed* The data 
resulting from these analyses are given and a discussion presented 
that does not attempt to explain all of the observed trends. Instru- 
ments used to collect information are incLtided. 

Dodson, Joseph H15HA Report Ho> 31^ Characteristics qI Successful In- 
sightful Problem Solvers . 1972* I39p* S2.00. (ERIC; ED 084 132, 
SE 016 689) 

A dissertation that sought to identify characteristics correlated with 
solving insightful problems, meaning nonroutine and challenging pro- 
blems but not tricks or pu^rles* A review of the literature Indi- 
cated s number of variables, whose ability to discriminate among 
ability groups of problem solvers was then determined. Data from 
the Z-Populatipn were used. 

Bridgham, Robert G. NLSHA R<?port Ho. 32> The Effects of Different 
Mathematics Curricula on Science Achievement in the Secondary 
School. 1972. I3p. S0*50. (ERIC: ED 084 133, SE 016 690) 

Focuses On the effect of new mathematics curricula on achievement in 
science* Those students from the Y-Populatlon who had taken the 
College Board science tests in biology* chemistry* or physics were 
the Subjects. Partial correlations were used to determine whether 
^ tife type of raatlaematics curriculum was related to science achievement 
after the effects of student aptitude* achlevementf sex, economic 
index, and number of years of ma thepia tics were partialled out. 
Correlation matrices for biology^ chemistry, and physics are pre- 
sented separately* 

Wilson, James and Begle, Edward G. (Eds.) HL3HA Ryeport Ho. 33 f 
Intercor relations of Mathematic al and Psvcholoeical Variables . 
1972. i06p. 51.50. (ERIC: ED 08^ 134, SE 016 691) 

Listing Of correlation coefficients where each mathematical scale 

has been paired with each psychological scale. Besides each 

correlation matrlxf a rotated factor matrix is given from the 

performed factor analysis. Ho attempt is made to interpret any 
of the data. 
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